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CHAPTER  1 

INTRODUCTION 


Learning  is  a  natural  cognitive  process.  People  and  other  living  creatures  learn  almost 
constantly  and  yet  very  little  is  understood  about  what  really  goes  on.  Part  of  the  interest  in 
learning  is  a  fascination  with  the  diversity  of  learning  situations.  There  is  learning  both  with 
and  without  a  teacher  (e.g.,  being  taught  to  identify  poisonous  vs.  edible  mushrooms  and 
learning  on  one's  own  the  characteristics  of  steak  cooked  different  ways),  and  there  is  learning  to 
perform  a  particular  task  (e.g.,  learning  to  tie  one's  shoe)  and  learning  that  reveals  interesting 
relationships  (e.g.,  learning  types  of  automobiles,  such  as  “foreign”  and  “domestic”).  The  study 
of  machine  algorithms  that  have  an  ability  to  learn  is  important  for  at  least  three  fundamental 
reasons.  First,  machines  that  learn  are  needed  to  help  solve  difficult  social,  technical,  and 
scientific  problems  of  man  in  his  universe.  Second,  by  comparing  the  capabilities  of  artificial 
learning  machines  with  human  learning,  cognitive  scientists  can  investigate  human  intelligence  as 
modeled  by  the  machine  learning  algorithms.  Third,  the  study  of  computer  algorithms  that 
learn  provides  insight  into  a  genre  of  software  that  is  different  in  many  respects  from  other 
computer  applications. 

This  thesis  describes  algorithms  (along  with  their  common  underlying  methodology)  that 
have  an  ability  to  learn  a  taxonomy  of  descriptive  concepts  from  examples  without  the 
assistance  of  a  teacher.  Each  of  the  above  reasons  for  studying  machine  learning  algorithms  is 
addressed.  From  the  point  of  view  of  helping  solve  real  problems,  learning  to  describe  collections 
of  examples  (so  called  learning  from  observation)  is  a  powerful  data  reduction  tool.  We  ourselves 
do  this  kind  of  reduction  on  data  we  receive,  without  even  noticing  it:  rather  than  remembering 
all  steaks  we  have  ever  eaten,  we  remember  them  as  {rare,  medium,  well  done}  or  as  {juicy. 
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tough},  etc.  The  sample  problem  presented  in  Chapter  5  shows  how  the  method  was  able  to 
rediscover  meaningful  categories  of  soybean  diseases.  From  the  point  of  view  of  cognitive  science 
research,  building  classifications  of  examples  by  machine  and  then  comparing  them  to  human 
classifications  can  reveal  hidden  algorithms  involved  in  human  intelligence.  The  sample  problem 
in  Chapter  7  has  been  used  to  study  both  human  and  machine  learning,  and  as  a  basis  for 
comparing  inductive  inference  processes  of  the  presented  methodology  with  those  processes 
involved  in  human  learning.  From  the  point  of  view  of  the  study  of  computer  algorithms,  the 
path-rank-ordered  (PRO)  search  described  in  Chapter  5  can  benefit  other  computational  tasks 
needing  a  specially  adapted  heuristic  search  through  an  immense  space.  These  are  the  broad 
topics  that  will  be  explored  in  the  thesis.  Specific  attention  will  be  given  to  the  algorithms  for 
building  a  concept  hierarchy  to  conceptually  describe  collections  of  examples.  This  is  a  process 
that  has  been  named  conceptual  clustering  by  Michalski  [Michalski,  1980b]. 

For  the  most  part,  the  thesis  is  concerned  with  a  single  variety  of  conceptual  clustering 
called  conjunctive  conceptual  clustering,  in  which  examples  and  conceptual  clusters  (classes)  are 
described  by  conjunctions  of  predicates  and  relations  over  function/value  pairs  The  focus  is 
placed  on  conjunctive  forms  of  representation  because  such  forms  are  commonly  used  in 
descriptive  statements  people  generate  to  describe  objects  and  concept  classes.  The  conjunctive 
concept  is  an  elegant  form  having  both  simplicity  and  expressive  power  This  provides  a 
representation  that  is  domain-independent  and  applicable  to  a  very  broad  range  of  problems 
while  at  the  same  time  being  easy  to  manipulate  by  the  application  of  a  wide  variety  of 
generalizing  and  specializing  transformations. 


1.1.  Four  learning  paradigms 


The  paradigm  of  “learning  from  observation’’  is  but  one  of  four  widely  recognized  forms  of 
learning  (for  both  man  and  intelligent  computer  programs).  The  four  forms  are  learning  from 
instruction,  learning  by  examples,  learning  by  analogy,  and  learning  from  observation.  In  all 


forms  of  learning,  some  external  agent  such  as  a  teacher  and/or  the  learning  environment  help 
direct  the  learning  to  varying  extents.  The  minimum  involvement  of  the  external  agent  occurs 
in  unsupervised  learning  where  the  teacher  provides  examples  to  consider  and  biases'  the  learner 
towards  certain  interpretations  and  away  from  others.  In  supervised  learning,  the  agent  is  a 
teacher  that  determines  how  each  example  is  to  be  used.  The  teacher  differentiates  between 
positive  and  negative  events  (or  between  events  belonging  to  different  classes)  either  by  assigning 
a  class  to  each  example  a  priori  or  by  serving  as  a  consultant  who  states  the  class  of  any 
example  when  queried  by  the  learner.  The  brief  outlines  that  follow  describe  the  unique 
characteristics  of  each  learning  paradigm. 

1.1.1.  Learning  by  instruction 

In  this  paradigm  of  learning,  the  teacher  provides  complete  predigested  knowledge  which 
the  learner  need  only  retain  and  apply.  Memorizing  rules  for  diagnosing  and  treating  measles  is 
an  example  of  this  kind  of  learning. 

1.1.2.  Learning  from  examples 

In  this  paradigm  of  supervised  learning,  the  teacher  provides  classified  examples  and 
counter-examples  of  the  phenomenon.  In  some  situations,  the  training  examples  are  carefully 
selected  by  the  teacher  so  as  to  be  close  to  the  conceptual  border  of  the  classes.  Such  examples 
are  called  outstanding  representatives  of  the  class.  Near  miss  events  just  outside  the  class  border 
are  profitably  used  as  negative  events.  In  this  form  of  learning,  the  learner  must  synthesize  a 
mechanism  for  recognizing  both  examples  and  counter-examples,  and  to  know  which  is  which. 
Learning  to  diagnose  a  particular  disease  from  a  set  of  examples  of  the  disease  and  a  set  of 
examples  of  other  diseases  and/or  examples  of  a  disease-free  condition  is  an  example  of  this  type 
of  learning. 


1  Those  preferences  that  are  built  into  the  method  are  called  the  6ia*  of  the  algorithm  jUtgoff,  198t| 


Past  work  on  this  form  of  learning  includes  building  descriptions  for  classes  of  blocks-world 
structures  (Winston,  1975];  a  family  of  inductive  learning  programs  based  on  the  Aq  algorithm 
[Nlichalski,  1972,  1983];  the  SPROUTER  program  which  forms  maximally  specific  conjunctive 
representations  [Haves-Roth,  197C;  Hayes-Roth  and  McDermott,  1977];  the  program  THOTH 
which  produces  maximal  unifying  generalizations  [V'ere,  1975];  the  program  META-DENDRAL 
for  discovering  cleavage  rules  to  explain  mass  spectrograms  and  give  ideas  about  molecular 
structure  (Buchanan  et  al„  1976];  and  the  program  INDUCE  for  determining  disjunctive 
structural  descriptions  of  structured  objects  [Larson  and  Michalski,  1977;  Larson,  1977].  A 
comparative  summary  of  such  methods  is  in  [Dietterich  and  Michalski,  1981]. 

1.1.3.  Learning  by  analogy 

This  type  of  supervised  learning  also  involves  examples  provided  by  a  teacher  but  the  goal 
is  to  discover  a  transformation  from  one  situation  to  another  and  to  apply  the  transformation  to 
new  situations.  Learning  the  properties  of  electric  current  flow  from  properties  of  fluid  flow  is 
an  example  of  this  type  of  learning.  The  paradigm  of  learning  by  analogy  is  not  discussed  in 
this  thesis.  Readers  are  referred  to  [Carbonell,  1983]  and  [Winston.  1979]  for  discussions  of 
recent  research  in  this  area. 

1.1.4.  Learning  from  observation  This  type  of  unsupervised  learning  involves  examples 
and  possibly  counter-examples,  but  unlike  the  paradigm  of  learning  from  examples,  the  goal  is  to 
synthesize  a  classification  of  the  collection  of  positive  examples  by  finding  patterns  which  reveal 
an  underlying  conceptual  structure  in  the  collection.  Conceptual  clustering  is  one  method  for 
building  classifications.2 

Unlike  the  other  three  learning  paradigms,  the  examples  are  not  assigned  initially  to 
different  classes.  If  counter-examples  are  provided,  they  are  used  in  a  way  that  is  different  from 

2  Throughout  the  thesis,  the  term  clauifieahon  will  refer  to  a  classification  resulting  from  the  application  or 
recursive  application  of  conceptual  clustering 


other  learning  methods.  Any  given  counter-examples  serve  to  bound  the  description  space  of 
possible  classifications  of  positive  examples  ( i.e. .  they  keep  the  generated  class  descriptions 
focused  on  the  kinds  of  entities  of  interest)  but  they  are  otherwise  incidental  to  the  classification 
building  process.  The  learner  alone  must  extract  relevant  information  from  descriptions  of 
examples  in  a  collection.  The  examples  are  related  to  each  other  in  many  ways  but  the  nature 
of  these  relations  is  unknown  to  the  learner. 

An  illustration  of  this  kind  of  learning  would  be  to  build  a  classification  of  cars  in  a 
parking  lot.  An  interesting  outcome  might  be  that  a  classification  of  cars  by  size  might  also 
classify  them  by  model  and  country  of  manufacture.  Since  there  is  no  ‘right"  or  “wrong" 
classification,  the  selection  of  a  preferred  classification  from  among  many  alternatives  is  based  on 
an  evaluation  criterion  that  reflects  the  goal  of  the  classification  and  on  the  bias  of  the 
classification  building  algorithm 

1.2.  Thesis  overview 

The  research  described  in  this  thesis  deals  with  problems  of  learning  from  observation.  In 
the  chapters  that  follow,  this  type  of  learning  will  be  further  defined  and  contrasted  with 
traditional  approaches  to  show  the  fundamental  differences  between  building  traditional 
numerically-based  taxonomies  and  concept-based  classifications.  Specific  algorithms  will  be 
detailed  for  building  classifications  of  examples  (objects  or  situations)  that  are  described  by 
vectors  of  attribute  values  and  those  that  are  described  by  a  more  general  predicate  calculus 
type  of  representation. 

Chapter  2  presents  background  information  relating  the  broad  area  of  learning  from 
observation  to  other  unsupervised  learning  approaches  such  as  numerical  taxonomy  and  other 
inference-based  discovery  systems.  Chapter  describes  the  inference  process  called  conceptual 
clustering  and  how  it  is  related  to  the  earlier  general-purpose  clustering  technique  called 
dynamic  clustering.  In  Chapter  4,  classification  building  via  conceptual  clustering  is  presented 


as  a  process  of  inductiv ;  inference. 

Several  conceptual  clustering  approaches  have  been  studied.  Chapter  5  describes  a  method 
for  building  classifications  for  unstructured  examples  that  are  described  by  vectors  of 
attribute/value  pairs.  Chapter  5  also  presents  sample  classifications  that  resulted  from  the 
application  of  the  method  to  a  problem  of  rediscovering  classes  of  soybean  diseases.  Chapter  6 
presents  a  related  but  implementationaily  different  method  of  conceptual  clustering  that  handles 
examples  described  by  an  extended  predicate  calculus.  The  method  is  illustrated  by  an  example 
problem  of  generating  classifications  of  blocks-world  objects.  Chapter  7  describes  a  two-tiered 
approach  that  uses  structural  patterns  found  in  a  collection  of  examples  to  buiid  a  structural 
template  with  which  a  derived  attribute-based  representation  is  constructed.  The  derived 
problem  description  is  processed  using  the  attribute-based  conceptual  clustering  algorithm  of 
Chapter  5.  This  approach  is  illustrated  with  an  example  problem  of  generating  a  classification 
of  some  artistically  conceived  trains.  Some  results  of  studies  by  Medin  on  human  classification 
building  for  the  toy  trains  problem  {Media,  Wattenmaker,  Michalski,  1984]  are  summarized  to 
relate  the  kinds  of  the  machine-generated  classifications  with  those  produced  by  humans. 


BACKGROUND 


2.1.  Learning  from  observation 

Problems  of  learning  from  observation  involve  unsupervised  learning  situations  in  which 
there  is  no  teacher.  The  learning  algorithm  is  presented  with  a  collection  of  entities  and  it  may 
do  with  them  as  it  wishes.  In  living  organisms,  this  kind  of  learning  is  motivated  by  the  burden 
of  learning  massive  amounts  of  data  by  rote.  If  strong  patterns  in  the  data  can  be  found,  then 
much  of  the  information  content  can  be  retained  more  easily  by  remembering  the  strong 
patterns  and  their  taxonomy  rather  than  the  individual  data  values.  For  example,  having 
learned  about  automobiles,  we  remember  the  important  characteristics  and  differences  between 
classes  of  automobiles  (by  building  taxonomies  of  automobiles)  without  specifically  remembering 
each  and  every  car  we  have  seen.  Learning  from  observation  is  a  powerful  and  indispensable 
data  reduction  and  knowledge  acquisition  paradigm. 

2.2.  Discovery  systems 

Learning  systems  which  engage  in  unsupervised  learning  are  called  discovery  systems. 
Classification-building  (this  work),  theory-formation,  and  development-of-heuristics  are  examples 
of  discovery  tasks. 

2.2.1.  Previous  conceptual  clustering  systems 

There  is  little  published  work  on  artificial  intelligence  algorithms  that  perform  conceptual 
clustering  other  than  those  of  Michalski  and  Stepp  [Michalski,  1980b;  Michalski,  Stepp  and 
Diday,  1981;  Stepp,  1984).  The  remainder  of  the  thesis  is  devoted  to  describing  research  based 


on  this  approach.  A  related  problem  of  building  conceptual  characterizations  was  studied  by 
Stepp  [Stepp,  1979|.  In  that  work,  inductive  inference  techniques  were  used  to  generate 
generalized  characteristic  descriptions  that  are  maximally  general  while  not  surpassing  a  given 
degree  of  generality1  threshold. 

2.2.2.  Clustering  within  a  problem  solving  system 

Problem  solving  often  requires  the  efficient  exploration  of  a  vast  state>space.  Recently, 
clustering  has  come  to  play  a  role  in  reducing  the  vastness  of  the  space  to  be  explored.  Rendell 
[1983]  describes  a  probabilistic  learning  system  (PLS)  that  performs  heuristic  searches  through 
the  space  of  possible  solutions  directed  by  the  utility  measure  called  penetrance2.  The  system 
contains  a  problem  solving  module  guided  by  a  control  structure  using  a  penetrance  evaluation 
function.  Different  hypothetical  solutions  are  clustered  into  regions  with  similar  penetrance 
values.  The  clusters  are  hypercubes  in  the  feature  space  and  are  generated  using  a  divisive 
numerical  clustering  method  in  which  the  similarity  measure  is  the  penetrance  score. 

Clustering  can  be  used  in  a  variety  of  ways  within  a  problem  solving  system.  The  PLS  system 
demonstrates  one  important  use  of  clustering  in  unsupervised  problem  solving  by  helping  form 
solution  regions  composed  of  hypothetical  solutions  with  similar  utility  scores.  Another  use  of 
clustering  in  problem  solving  would  be  to  reformulate  the  problem  by  subdividing  it  into  sets  of 
conceptually  similar  subproblems  by  conceptually  clustering  the  problem  goals  or  subgoals.  This 
kind  of  clustering  into  conceptually  similar  entities  (rather  than  numerically  similar  entities)  is 
not  performed  by  PLS. 

1  A  generalised  description  describes  a  set  of  points  in  the  object  representation  subspace  covered  by  the  description 
The  subspace  may  contain  points  representing  both  some  actual  objects  given  with  the  problem,  and  a  larger  set  of 
distinct  hypothetical  objec's  that  are  possible  but  not  observed.  The  degree  of  generality  of  a  description  is  measured 
as  the  ratio  of  the  number  of  distinct  hypothetical  objects  in  the  subspace  to  the  number  of  actual  objects  in  the  same 
subspace 

2  The  penetrance  of  a  search  tree  is  the  ratio  of  the  solution  path  length  to  the  total  number  of  states  developed 
Doran  and  Michie,  1 966 j 


2.2.3.  Theory  formation  systema 


Current  work  in  automated  theory  formation  is  represented  by  the  BACON  system 
[Langley,  Bradshaw  and  Simon,  1983).  The  BACON  system  (a  family  of  programs)  is  a 
production  system  that  discovers  empirical  laws.  Equipped  with  a  small  set  of  heuristics,  it 
detects  regularities  in  numeric  and  nominal3  data  to  formulate  hypotheses  about  functional 
dependencies  between  variables  and  associations  of  values  of  nominal  variables  with  intrinsic 
properties.  The  system  processes  empirical  data  and  formulates  summary  descriptions  at  several 
levels  of  generality.  For  example,  when  given  experimental  data  consisting  of  pressure,  volume, 
temperature,  and  name  of  gas  for  different  gasses  over  a  range  of  volumes  and  temperatures, 
BACON  discovers  that  pV/T  is  constant  for  each  gas  and  that  there  is  an  intrinsic  property  “n" 
associated  with  the  name  of  each  gas  which  varies  with  the  values  of  p,  V,  and  T  according  to 
the  equation  pV/nT  =  8.31  joule/degree.4 

2.2.4.  Systems  for  developing  heuristics 

Work  in  generating  heuristics  has  led  to  the  creation  of  the  two  systems  AM  and 
EURISKO  [Lenat,  1983).  AM  and  EURISKO  incorporate  theory-driven  discovery  techniques 
and  are  specially  designed  to  solve  a  unique  class  of  problems.  Their  specialization  immediately 
separates  them  from  the  general-purpose  classification-building  approach  presented  here.  AM  is 
a  discovery  program  that  can  learn  number  theory  concepts.  Given  a  large  number  of 
mathematical  concepts,  represented  in  a  frame-like  fashion,  and  a  still  larger  number  of  heuristic 
rules,  AM  sets  out  to  look  for  regularities  and  interesting  patterns  in  the  concepts  and  in  specific 
examples  of  the  concepts.  Local  heuristic  rules  are  used  to  update  an  agenda  composed  of  a  list 
of  specific  tasks  to  be  performed.  Some  tasks  explore  certain  properties  of  concepts;  other  tasks 
define  new  concepts. 

3  Numeric  data  ar e  measured  ou  an  ordered  scale  Notnioal  data  are  measured  oo  a  nominal  scale 

4  From  physics  we  know  integer  n  is  the  ratio  m/M  where  m  is  the  mass  of  the  gas  and  M  is  its  molecular  weight 
The  actual  intrinsic  property  is  the  molecular  weight  M  When  BACON  is  given  only  one  sample  of  each  gas  it  cannot 
detect  the  dependency  on  the  mass  m  When  n  is  interpreted  as  the  mass  of  the  gas  in  moles,  the  ratio  pV/nT  is  the 
universal  gas  constant  %  31  joule  mole-degree 


The  system  operates  in  a  select/execute  loop  in  which  the  sole  goal  is  to  maximize  the 
quality  of  the  activities  performed,  i.e.,  to  execute  the  tasks  on  the  agenda  with  the  highest 
worth.  This  heuristic-based  approach  was  given  a  set  of  prenumerical  concepts  and 
proceeded  to  discover  a  variety  of  additional  concepts  (set  membership  laws,  natural 
numbers,  arithmetic  operators,  square-root,  prime,  etc.).  The  EURISKO  program  has  been 
used  to  discover  new  heuristics  and  new  kinds  of  representations,  e  g.,  new  slots  for  the 
frame-like  concept  representation  it  uses. 

2.3.  Feature  extraction  and  noise  reduction 

Learning  from  observation  can  also  be  viewed  as  feature  extraction  or  attribute  filtering. 
With  a  (less  than  optimal)  representation  of  any  phenomenon  there  may  be  some  attributes  that 
are  irrelevant  to  the  situation  at  hand  or  whose  values  are  noisy  and  inexact.  The  elimination  of 
irrelevant  attributes  and  the  suppression  of  noise  in  the  data  can  be  considered  as  a 
transformation  of  the  space  of  representations  or  the  phenomenon.  This  space,  called  the  event 
space,6  is  an  n-dimensional  space  in  which  each  point  represents  a  possible  combination  of 
attribute  values.  A  collection  of  examples  can  be  mapped  into  this  space  giving  rue  to  some 
distribution  of  marked  points,  one  for  each  example  (some  events  may  coincide).  By  reducing 
the  dimensionality  of  the  space  and  by  reducing  the  number  of  distinct  values  along  single 
dimensions,  the  size  of  the  space  is  made  smaller.  While  there  is  no  virtue  in  small  event  spaces 
per  se,  the  reduction  in  size  of  the  space  leads  to  simpler  descriptions  of  both  examples  and 
groups  of  examples  located  in  the  space.  Some  transformations  cause  more  than  one  example  to 
be  translated  into  the  same  point  in  the  new  space.  Such  a  point  in  the  new  space  represents  a 
class  (or  cluster)  of  examples  rather  than  just  a  single  object.  Consider  the  following  situations: 

S  The  terms  ettmplt  ind  event  ire  used  synonymously  Thus,  the  event  sp»ce  is  the  spice  in  which  eirh  eximple 
cm  be  represented  distinctly 


2.3.1.  Feature  extraction 

Suppose  the  examples  are  descriptions  of  certain  animals  (birds  and  mammals  only,  but 
this  fact  is  not  presented  to  the  learner).  Each  individual  animal  is  described  by  30  attributes 
such  as  size,  coloring,  type  of  teeth,  where  it  lives,  what  it  eats,  etc.  The  event  space  for  such  a 
problem  is  immense.  By  noting  a  pattern  in  the  data  that  differentiates  birds  from  mammals, 
one  might  propose  a  classification  involving  just  those  attributes  that  distinguish  birds  from 
mammals.  Similarly,  one  might  also  notice  a  pattern  that  distinguishes  those  animals  that  live 
in  or  on  the  water  from  those  that  live  on  land.  A  projection  of  the  event  space  onto  just  those 
relevant  attributes  would  condense  the  space  into  four  categories:  birds  that  live  on  land,  water 
birds,  '"'■nd-living  mammals,  and  water-living  mammals.  The  resulting  event  space  would  consist 
of  just  four  points  corresponding  to  four  specific  subspaces  of  the  original  event  space.  Only  a 
fraction  of  the  original  attributes  (or  a  new  set  of  derived  attributes)  would  be  dimensions  in  the 
reduced  event  space.  This  process  is  a  feature  extraction  performed  over  the  original  attributes. 
Traditional  approaches  to  feature  extraction  are  based  on  co-variances  between  attribute  values. 
Such  methods  build  a  reduced  set  of  attributes  from  linear  combinations  of  original  attributes 
such  that  the  new  attributes  are  mutually  orthogonal. 

2.3.2.  Noise  reduction 

The  following  example  will  illustrate  the  ability  to  reduce  noise  through  learning.  Suppose 
the  process  being  analyzed  involves  arrows  shot  from  a  bow  bitting  a  target,  with  the  attention 
placed  on  where  the  arrows  hit  rather  than  how  they  are  shot.  The  complete  event  space  would 
consist  of  positional  information  describing  where  the  arrow  bit  the  target.  This  two- 
dimensional  space  can  be  visualized  much  like  the  target  itself,  with  the  holes  left  by  the  arrows 
becoming  the  points  in  the  event  space  representing  observed  examples  of  the  phenomenon 
Suppose  that  the  archer  is  very  skilled  or  replaced  by  a  flawless  machine.  The  arrows  are 
launched  identically  for  each  example  Even  so.  ballistic  scattering  prevents  them  from  hitting 
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the  target  in  exactly  the  same  place  even  though  each  arrow  is  an  example  of  exactly  the  same 
phenomenon.  Transforming  the  event  space  by  reducing  the  number  of  possible  position  values 
of  arrow  impacts  (e.g.,  by  drawing  concentric  circles  around  the  target  center  and  measuring 
impact  position  only  in  terms  of  which  region  was  entered)  reduces  the  ballistic  noise  in  the  data. 


These  kinds  of  data  reduction  and  data  analysis  techniques  have  been  practiced  within  the 
traditional  methods  of  multidimensional  scaling,  feature  extraction,  and  numerical  taxonomy. 
A  survey  of  traditional  clustering  techniques  may  be  found  in  [Anderberg,  1973]  and  [Duda  and 
Hart,  1973].  Complete  coverage  of  numerical  taxonomy  is  contained  in  (Sokal  and  Sneath,  1963]. 
The  traditional  approaches  to  data  reduction  problems  have  been  based  on  numerical  or 
statistical  methods.  Such  approaches  are  appropriate  for  some  problems,  but  not  when  a 
conceptual  understanding  of  the  generated  classes  is  sought.  In  such  cases  the  results  are  often 
difficult  to  interpret  or  apply. 


In  the  following  section  the  traditional  method  of  numerical  taxonomy  will  be  briefly 
summarized  to  emphasize  the  differences  between  the  traditional  (non-conceptual)  approaches 
and  the  inductive-inference-based  (conceptual)  approach  that  is  the  focus  of  subsequent 
chapters. 


2.4.  Numerical  taxonomy 

Numerical  taxonomy  is  a  technique  that  assembles  examples  into  a  tree-structured 
dendrogram  such  as  the  one  shown  in  Fig.  2.1.  A  given  distance  metric  (e  g.,  Euclidean  distance) 
is  applied  between  every  pair  of  examples.  The  two  examples  which  yield  the  lowest  distance 
value  are  merged  into  one  composite  unit  or  group.  The  distance  function  is  reevaluated  over 
all  remaining  entities,  with  the  newly  formed  group  behaving  as  one  entity.  The  distance 
function  must  thus  be  capable  of  measuring  not  only  example-to-example  distance,  but  also 
example-to-group  and  group-to-group  distances.  There  are  many  ways  to  facilitate  measuring 
distance  relative  to  a  group,  given  only  an  example-to-example  distance  function.  The  so  called 
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complete  linkage  methods  measure  group  distance  values  by  considering  all  distances  from 
examples  in  one  group  to  those  in  the  other  group  and  then  taking  the  maximum  distance.  The 
single  linkage  methods  do  the  same  thing,  but  use  the  minimum  distance.  The  so  called  average 
linkage  methods  take  the  arithmetic  average  of  the  distances.  There  is  no  universal  agreement 
on  which  of  the  three  group  distance  measurement  techniques  is  best  [Sokal  and  Sneath,  1963]. 

On  each  iteration  of  the  merging  operation,  a  group  or  example  is  merged  with  another 
group  or  example  if  the  distance  between  them  is  the  smallest.  This  continues  until  only  one 
group  remains.  The  history  of  the  merging  operations  is  represented  as  a  tree  (usually  rooted  at 
the  left)  in  which  each  intermediate  node  is  positioned  horizontally  according  to  an  axis  denoting 
the  distances  between  the  merged  entities.  A  sample  dendrogram  is  shown  in  Fig.  2.1.  A 
dendrogram  may  be  cut  apart  at  some  distance  value  to  form  a  number  of  separate  clusters  of 
numerically  similar  entities.  In  Fig.  2.1  there  is  a  wavy  line  showning  where  the  dendrogram  can 
be  cut  to  form  4  clusters. 

The  mam  limitation  of  numerical  taxonomy  is  that  it  is  numerical  rather  than  conceptual. 
The  numerical  techniques  introduce  many  arbitrary  biases  and  give  rise  to  two  fundamental 
problems: 

1.  The  distance  metric  typically  requires  all  attributes  (dimensions)  to  be  of  ordered  scale. 
Distance  metrics  for  nominal  scale  attributes  (for  which  tue  magnitudes  of  the  differences 
in  values  are  meaningless)  are  often  based  on  the  so  called  simple  matching  score 8 
similarity  measure.  When  a  mixture  of  ordinal  and  nominal  attribute  types  is  present, 
there  is  a  severe  problem  of  how  to  combine  the  two  different  measures.  This  problem  is 
usually  handled  by  ignoring  it,  i.e.,  by  mapping  the  nominal  values  into  the  integers 
starting  with  zero,  and  then  pretending  the  scale  is  ordered  rather  than  nomiual.  This 
gives  nominal  values  unequal  and  arbitrary  weights.  AH  kinds  of  clever  distance  metrics 

S  Th<  simple  matching  score  is  measured  by  counting  the  number  of  corresponding  attributes  of  two  entities  that 
have  the  same  value 
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The  wavy  line  shows  where  to  cut  to  create  four  classes. 
Figure  2.1.  A  dendrogram  of  diseased  soybeans 


have  been  devised  (a  brief  summary  can  be  found  in  (Michaiski,  Stepp  and  Diday,  1981]) 
but  the  problem  of  handling  both  nominal  and  ordered  attributes  in  one  distance  metric 
has  not  received  a  satisfactory  solution. 

2.  The  attributes  used  to  describe  entities  may  have  substantially  different  ranges  of  values, 
even  if  they  are  all  of  the  same  scale.  If  raw  numerical  values  are  used,  then  there  is  an 
implied  arbitrary  weighting  that  corresponds  to  irrelevant  factors  such  as  unit  size  of  the 
measurements  (e.g.,  one  attribute  is  measured  in  feet  and  one  is  measured  in  inches;  or 
worse  yet  one  is  measured  in  feet  and  another  is  measured  in  pounds).  Statistical 
techniques  such  as  normalization  or  standardization  may  be  used  though  such  techniques 
merely  substitute  one  arbitrary  weighting  for  another  one.  How  to  choose  weights  is  an 
unanswered  question  in  numerical  taxonomy.  In  many  instances,  the  weights  are  assumed 
to  be  1.0  for  lack  of  any  better  wisdom. 

Numerical  taxonomy  has  two  redeeming  characteristics:  it  is  fast,  and  it  is  useful  for  those 
classification-building  problems  in  which  distance  is  a  relevant  parameter.  Even  when  the 
technique  is  appropriate,  the  output  such  as  the  dendrogram  shown  in  Fig.  2.1  is  devoid  of 
interpretation.  When  a  data  analyst  partitions  examples  by  way  of  a  dendrogram,  the 
significance  and  description  of  each  class  must  be  determined  by  external  means,  generally 
through  the  perceptual  abilities  of  the  analyst  himself.  The  mathematical  nature  of  the 
numerical  taxonomy  process  cannot  produce  patterns  of  objects  that  (except  by  coincidence) 
match  concepts  people  might  use  to  describe  them. 


CHAPTER  3 


THE  CONCEPTUAL  CLUSTERING  PARADIGM 


This  chapter  discusses  the  fundamental  properties  of  conceptual  clustering  by  focusing 
primarily  on  those  facets  which  differentiate  conceptual  clustering  from  other  clustering 
techniques.  Since  the  thesis  is  concerned  with  conceptual  clustering,  the  chapter  begins  with 
some  notions  about  concepts  and  how  they  are  different  from  names  for  things.  The  next 
section  discusses  the  general  process  of  building  a  concept-based  classification  of  examples  using 
conceptual  clustering.  The  clusters  (classes)  formed  are  described  by  concepts  and  are  composed 
of  examples  that  are  similar,  not  by  a  conventional  mathematical  measure  of  similarity,  but  by  a 
conceptual  similarity  measure  introduced  by  Michalski  [1980b]  called  conceptual  cohesiveness. 

Following  the  introduction  of  conceptual  cohesiveness,  two  sections  present  the  three  basic 
approaches  to  non-conceptuai  clustering  and  then  briefly  describe  the  so-called  dynamic 
clustering  approach  that  is  part  of  the  framework  on  which  the  method  of  conceptual  clustering 
is  built.  Another  fundamental  part  of  the  underlying  framework  is  a  reliance  on  various  kinds  of 
background  knowledge.  The  role  of  such  knowledge  in  clustering  is  described  in  Sec.  3.6. 
Finally,  the  chapter  ends  with  three  variations  of  the  clustering  paradigm  that  handle  one 
dimensional  clustering,  clustering  of  weighted  examples,  and  clustering  in  the  presence  of 

I 

negative  examples.  These  topics  in  Chapter  3  are  preparatory  to  the  introduction  of  the 

|  underlying  inductive  inference  algorithms  which  starts  in  Chapter  4. 

* 

;  3.1.  Concepts 

There  is  still  some  debate  in  philosophical  discussions  about  just  what  is  meant  by  the  term 

concept.  A  clear  distinction  exists  between  “Joe’s  telephone  number”  as  a  particular  7-digit 
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number  and  “Joe's  telephone  number”  as  a  description  of  some  object  class.  Although  one  could 
argue  that  even  “555-1234”  (a  particular  7-digit  number)  is  an  “elementary  concept”  because  it 
describes  the  object  class  that  contains  itself  as  the  only  object,  such  usage  is  extreme  and 
limiting.  Without  loss  of  generality,  the  term  concept  will  be  taken  to  mean  a  description  of  a 
class  of  potentially  many  entities. 

The  underlying  distinction  between  names  of  things  and  concepts  is  that  concepts  come 
with  certain  properties  of  entities  belonging  to  the  concept  class.  Rather  than  “Joe’s  telephone 
number”  being  just  a  name  for  a  certain  number,  the  concept  “Joe’s  telephone  number”  has 
properties  that  do  not  depend  on  what  number  “Joe’s  telephone  number”  happens  to  be.  Some 
of  the  properties  are: 

1.  The  number  will  be  accepted  by  the  phone  system. 

2.  When  called,  Joe  is  likely  to  answer. 

3.  When  called,  a  message  may  be  given  to  Joe  or  left  for  him  to  receive  later. 

A  concept  exists  whether  there  is  a  phrase  in  the  English  language  for  it  or  not.  If  denoted  by  a 
single  phrase,  it  is  possible  to  construct  an  equivalence  between  the  assertion  that  an  object  is 
such  a  concept  and  a  statement  (usually  conjunctive)  of  the  properties  exhibited  by  such  an 
entity.  For  example 

V  is_Joe’s_teIephone_number(tJ/)  <—  > 
accepted_by_system(»|/)  A  likely _to_answer( Joe, <(»)  A  send_mcssage_to(»|»,Joe) 
represents,  in  predicate  calculus  notation,  the  equivalence  between  the  named  concept  “Joe's 
telephone  number”  and  its  property  set.  Concepts  not  previously  defined  in  the  English 
language  may  be  represented  by  stating  just  the  property  set,  i.e.,  by  giving  a  logical  statement 
such  as  the  right  hand  side  of  the  above  equivalence. 

A  powerful  conceptual  form  which  is  frequently  used  by  people  when  describing  concepts  is 
the  conjunctive  statement.  In  the  research  described  in  Chapters  1  to  7,  all  concepts  are 
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conjunctive  statements.  Concepts  will  be  represented  in  either  extended  propositional  logic  or 
extended  predicate  calculus  using  subsets  of  Annotated  Predicate  Calculus  (APC)  [Michalski, 
1983].  Thus,  in  this  thesis,  a  concept  is  a  conjunctive  statement  in  APC.  The  described 
conjunctive  conceptual  clustering  is  a  process  that  generates  conjunctive-form  concepts. 

3.2.  Classification  building 

A  class  is  composed  of  entities  that  are  instances  of  some  concept.  A  classifier  is  a  process 
that  maps  every  possible  entity  into  one  or  more  classes,  according  to  a  set  of  class  recognition 
rules  or  class  descriptions.  Both  class  recognition  rules  and  class  descriptions  can  be  written  in 
the  form 

CONDITION  =£>  CLASS-NAME 

where  CONDITION  is  a  statement  that  is  satisfied  by  every  example  of  the  class  whose  name  is 
CLASS-NAME.  The  condition  part  of  a  class  recognition  rule  is  usually  maximally  general 
under  the  constraint  that  it  remains  unsatisfied  for  any  example  of  another  class.  The  condition 
part  of  a  class  description  is  maximally  specific  under  the  constraint  that  it  is  in  acceptable 
form,  e.g.,  the  form  may  be  limited  to  that  of  conjunctive  concepts — this  would  necessitate  a 
certain  amount  of  generalization  to  3void  disjunction.  A  class  recognition  rule  contains 
discriminant  features  that  are  predicates  and/or  functions  which  take  different  non-intersecting 
value  sets  in  different  classes.  Class  descriptions  contain  characteristic  features  that  have  value 
sets  representing  the  observed  values  for  examples  of  the  class.  Value  sets  of  characteristic 
features  of  different  classes  may  intersect. 

For  traditional  classifications,  the  class-recognition  rule  may  be  a  discriminant  function 
which  defines  a  boundary  separating  one  class  from  another  (e  g.,  a  hyperplane).  For  conceptual 
classifications  created  by  conceptual  clustering,  we  are  interested  in  class  descriptions  that  are 
concepts.  Conceptual  class  recognition  rules  may  be  obtained  by  maximally  generalizing  class 
descriptions,  i.e.,  by  removing  the  characteristic  features  and  keeping  only  the  discriminant  ones. 


A  classification  of  a  given  set  of  objects  is  a  partitioning  of  the  set  into  k  subsets  according 
to  a  certain  classifier.  In  the  thesis  no  attention  is  given  to  classifications  based  on  arbitrary 
partitionings  of  objects,  but  rather  to  cases  where  the  partitioning  is  based  on  concept  class 
membership.  In  such  cases  of  conceptual  classification  building,  both  the  partitioning  of 
examples  and  the  classifier  are  generated  by  the  classification  building  process.  A  hierarchical 
classification  is  obtained  by  recursively  building  hierarchical  or  non-hierarchical  classifications 
for  each  of  the  subsets  of  objects  resulting  from  a  top-level  (or  the  previous  level)  classification. 

The  process  of  building  a  conceptual  classification  for  a  collection  of  objects  involves 
synthesizing  an  optimized  classifier  using  conceptual  clustering  and  using  it  to  arrange  the 
objects  by  class.  The  classification  is  evaluated  according  to  the  evaluation  criterion  {goal)  and 
if  alternative  classifications  are  possible,  the  one  with  the  best  evaluation  score  is  selected  (i.e., 
the  one  that  most  nearly  attains  the  goal  of  the  classification  is  selected). 

When  objects  are  arranged  into  groups  by  building  conceptual  classifications,  the  objects  in 
one  group  are  not  merely  similar  to  each  other  in  a  conventional  way,  but  have  high  conceptual 
cohesiveness  (defined  below)  because  they  are  all  instances  of  the  same  concept.  The  idea  of 
conceptual  cohesiveness  [Michalski,  1980b]  is  fundamental  to  the  theory  underlying  conceptual 
clustering. 

3.3.  Conceptual  cohesivenens 

In  traditional  clustering  approaches,  the  similarity  between  objects  A  and  B  depends  only 
on  their  attribute  values.  Measures  such  as  reciprocal  Euclidean  distance  and  the  so  called 
simple  matching  score  (the  number  of  attributes  having  the  same  value  for  both  objects)  are 
functions  that  are  based  solely  on  the  values  of  the  attributes  of  the  compared  objects,  i.e.,  the 
similarity  is  some  function  of  the  attributes  of  A  and  B: 

sim  =  f(A,B) 

To  permit  the  similarity  measure  to  take  into  account  patterns  which  can  only  be  detected  when 


considering  more  than  two  objects  at  a  time,  the  environment  of  the  compared  objects  (i.e., 
attribute  values  for  surrounding  objects)  is  also  used.  This  context  sensitive  measure  of 
similarity  is  a  function  of  three  parameters: 

sim  =  f(A,B,E) 

where  E  denotes  the  descriptions  of  all  objects  in  the  environment  of  objects  A  and  B.  An 
example  of  this  kind  of  similarity  measure  is  the  reciprocal  of  “mutual  distance'  (Gowda  and 
Krishna,  1978|.  To  calculate  the  mutual  distance  between  objects  A  and  B,  all  objects  are 
ranked  according  to  the  Euclidean  distance  to  A  (the  closest  object  is  ranked  1)  and  then 
according  to  the  distance  to  B.  The  mutual  distance  from  A  to  B  is  the  sum  of  the  rank  value 
of  A  with  respect  to  B  and  the  rank  value  of  B  with  respect  to  A. 

Taking  neighboring  objects  into  consideration  solves  some  clustering  problems,  but  in 
general  is  not  sufficient.  The  difficulty  lies  in  the  fact  that  the  above  types  of  similarity 
measures  are  still  concept- free,  i.e.,  they  depend  only  on  the  properties  of  individual  objects  and 
not  on  any  concepts  that  might  be  useful  to  characterize  object  configurations.  Consequently, 
methods  that  use  concept-free  measures  are  fundamentally  unable  to  capture  the  gestalt 
properties  of  object  clusters,  i.e.,  properties  that  conceptually  characterize  a  cluster  as  a  whole 
and  are  not  derivable  from  properties  of  individual  entities.  In  order  to  detect  such  properties, 
the  system  must  be  equipped  with  the  ability  to  recognize  configurations  of  objects  that 
correspond  to  certain  concepts. 

This  idea  is  the  basis  of  conceptual  clustering.  The  conceptual  similarity  between  two 
objects  A  and  B,  which  is  called  the  conceptual  cohesiveness  of  A  and  B,  depends  not  only  on 
those  objects  and  surrounding  objects  in  environment  E,  but  also  on  a  set  of  concepts  C  that  are 
available  for  describing  A  and  B  together  with  other  objects  [Nlichalski,  1980bj.  Thus,  the 
conceptual  cohesiveness  between  two  objects  A  and  B  is  a  four-argument  function 
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3.4.  A  taxonomy  of  clustering  techniques 

Clustering  techniques  come  in  three  basic  forms:  agglomerative  techniques  such  as 
numerical  taxonomy  that  repeatedly  join  separate  entities  and  small  groups  together,  forming 
larger  and  larger  groupings  until  only  one  group  exists;  divisive  techniques  that  repeatedly  break 
an  initial  single  starting  group  into  smaller  and  smaller  chunks  until  only  single  entities  exist  in 
each  chunk;  and  direct 1  techniques  that  are  given  the  number  k  and  proceed  to  construct  k 
clusters  by  arranging  (and  iteratively  rearranging)  the  entities  into  k  groups. 

The  optimal  number  of  clusters  is  determined  differently  in  each  approach.  For  divisive 
cluster  formation,  a  stopping  criterion  determines  when  to  cease  further  cluster  division  at  some 
optimum  stage  prior  to  obtaining  clusters  composed  of  single  entities.  For  agglomerative 
clustering,  the  entire  agglomeration  is  completed  while  producing  a  dendrogram  such  as  the  one 
shown  in  Fig.  2.1.  The  dendrogram  is  then  cut  into  clusters  according  to  a  between-group 
similarity  threshold.  For  direct  clustering,  the  number  of  clusters  is  given.  An  optimal  number 
of  clusters  to  form  can  be  found  by  performing  direct  clustering  for  a  range  of  values  for  k,  and 
then  selecting  the  clustering  that  is  best  according  to  an  overall  criterion  that  is  valid  over 
clusterings  with  varying  numbers  of  clusters. 

Agglomerative  techniques  merge  together  individual  entities  and  small  groups  according  to 
locally  applied  similarity  scores.  This  makes  such  techniques  inappropriate  for  finding  global 
patterns  in  the  data  which  may  only  be  revealed  by  considering  larger  groups  of  objects 
together.  Divisive  techniques  split  a  large  group  into  two  smaller  groups.  This  leads  to  a 
hierarchy  of  object  groups.  One  problem  with  divisive  clustering  is  th3t  the  criterion  for  how  to 
split  a  group  may  be  sensitive  to  global  patterns  in  the  collection  of  objects  A  poor  split  early 
in  the  algorithm  cannot  be  overcome  at  later  stages.  Direct  techniques  are  best  suited  for 
optimizing  a  global  criterion. 

1  Some  writers  use  the  term  non-hier®rehieaf  to  describe  clustering  techniques  tbit  ire  given  the  number  of  dusters 
to  form  a  priori  Thit  term  is  misleiding  a  the  context  of  the  methods  presented  here  which  build  hienrchies  of 
clisses  by  recursively  ipplving  i  direct  clustering  technique. 
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The  approach  taken  in  the  conceptual  clustering  method  described  in  this  thesis  is  to 
perform  direct  clustering  to  partition  a  group  of  entities  into  classes  according  to  a  set  of 
conceptual  class  descriptions.  The  classes  may  be  further  subdivided  by  recursively  reapplying 
the  conceptual  clustering  algorithm  to  each  class.  The  result  is  a  conceptual  hierarchy.  The 
direct  clustering  scheme  used  is  an  adaptation  of  an  approach  known  as  dynamic  clustering. 

3.5.  Dynamic  clustering 

The  dynamic  clustering  method  [Diday  and  Simon,  1976;  Diday,  1978)  is  a  direct  clustering 
technique  that  finds  clusters  iteratively  by  alternately  applying  a  representation  function  and  an 
allocation  function  until  a  stopping  criterion  is  reached.  The  technique  is  related  to  earlier 
techniques  such  as  K-mtans  (MacQueen,  1967)  and  Center  adjustment  [Meisel,  1972).  These  two 
techniques  use  reciprocal  Euclidean  distance  as  the  similarity  metric  and  represent  clusters  by 
their  centers  of  mass.  They  do  not  perform  conceptual  clustering. 

In  dynamic  clustering,  the  representation  function  forms  a  representative  set  for  each  of 
the  k  clusters.  A  typical  representative  set  for  a  cluster  would  be  one  or  more  objects  from  the 
cluster  that  best  illustrate  the  characteristics  of  all  objects  in  the  cluster,  eg,  an  object  that  is 
conceptually  central  among  the  objects  in  the  cluster.  One  way  to  measure  the  conceptual 
“centralness"  of  objects  is  by  summing  an  attribute-value  difference  measure  applied  between  all 
object  pairs  in  the  cluster.  (Such  a  measure,  called  the  syntactic  distance  between  two  concepts, 
is  defined  in  Chapter  4.) 

The  allocation  function  partitions  the  set  of  objects  to  be  clustered  according  to  object 
similarity  to  representative  objects.  These  processes  are  illustrated  in  simplified  form  by  the 
diagrams  shown  in  Fig.  3.1.  In  panel  (a)  one  representative  object  (the  seed  event)  is  selected  for 
each  class.  One  feature  of  dynamic  clustering  is  that  the  initial  choice  of  seed  events  is  not  very 
important.  As  shown  in  panel  (a),  the  initial  seed  choice  with  both  examples  fairly  close  together 
in  the  event  space  is  quite  poor.  Even  so,  a  good  clustering  is  established  in  panel  (d)  after 
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Obtain  initial  representation.  Two 
seed  events  et  and  e„  are  selected  at 
random.  (Seed  events  are  circled.) 
The  similarity  function  is  reciprocal 
Euclidean  distance. 


Allocate  events  to  classes.  Points 
most  similar  to  e{  are  placed  into  class 
Cr  Points  most  similar  to  e2  are 
placed  into  class  c,.  The  dashed  line 
shows  the  boundary  beween  class 
spaces. 
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Form  new  representation.  A  new 
representative  is  selected  for  each 
class.  The  most  central  event  having 
the  minimum  sum  of  distances  to 
other  events  in  the  same  class  is 
selected.  The  thin  lines  mark  the 
distances  summed  for  the  selected 
events. 


Allocate  events  to  classes.  Allocation 
is  performed  as  in  snapshot  (b)  using 
the  new  seed  events.  Note  that  after 
just  two  full  iterations  the  method  has 
discovered  the  strong  pattern  of  two 
groups  of  points.  Subsequent 
iterations  of  the  algorithm  will 
indicate  the  same  two  class  solution. 


Figure  3.1.  An  illustration  of  dynamic  clustering  with  two  classes. 


completing  only  two  iterations  In  panel  (b)  the  examples  are  allocated  to  classes  on  the  basis  of 
similarity  to  the  seed  of  the  class.  In  the  (non-conceptual)  illustration,  the  classes  are  delineated 
by  the  hyperplane  border  shown  as  the  dashed  line.  Panel  (c)  illustrates  the  process  of  selecting 
new  seed  events.  Sums  of  distances  between  all  events  that  were  in  class  Cl  in  panel  (b)  are 
calculated.  The  event  shown  (labeled  es)  is  the  one  whose  sum  of  distances  was  lowest.  It  is  one 
of  the  two  seeds  for  the  next  iteration.  From  the  events  which  were  in  class  C2  the  other  new 
seed  event  e4  is  selected  in  a  similar  fashion.  In  panel  (d)  the  two  new  seed  events  are  used  to 
again  allocate  all  events  to  classes,  performing  the  same  process  used  in  panel  (b).  The  class 
regions  Cl  and  C2  correspond  to  the  spatially  apparent  clusters  of  points.  Further  iterations 
will  maintain  this  same  partitioning,  although  the  hyperplane  will  move  closer  to  the  center  of 
the  space. 

3.0.  The  role  of  background  knowledge 

It  can  be  observed  that  when  people  create  a  classification  of  observations  or  partition  a 
system  into  subsystems,  they  employ  knowledge  about  various  concepts  and  relationships  on 
attribute  value  sets  that  are  relevant  for  describing  the  observations  or  the  system.  This 
knowledge  which  is  independent  of  the  descriptions  of  the  examples  will  be  called  background 
knowledge.  It  can  provide  specialized  generalization  transformations  over  attribute  values  and 
an  ability  to  construct  new  descriptors  (attributes,  functions,  or  predicates)  from  those  that  arc 
initially  given.  Both  of  these  applications  of  background  knowledge  to  the  construction  of 
classifications  add  a  powerful  capability  that  humans  innately  possess  but  which  few  inference 
programs  do 

Background  knowledge  also  solves  a  nagging  classification  building  problem:  that  of 
deciding  which  of  the  multitude  of  possible  classifications  for  the  same  example  set  are  best. 
Since  there  are  no  right  or  wrong  classifications,  the  term  “best"  is  hard  to  define  Part  of  the 
role  of  background  knowledge  is  to  specify  the  bias  of  the  classification  building  process,  i.e..  to 
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provide  an  appropriate  mechanism  to  evaluate  classifications  and  select  one  which  best  meets  the 
goal  criterion.  The  term  bias  denotes  the  cumulative  influences  of  an  inference  process  on  the 
generation  and  selection  of  alternative  hypotheses  [1'tgoff,  1984], 

During  classification  generation,  the  incomplete  hypotheses  are  evaluated  The  best  ones 
survive  to  become  final  results  while  computational  resources  are  deprived  from  those 
classifications  which  fall  short.  In  the  work  described  in  this  thesis,  tactical  knowledge  of  how  to 
evaluate  classifications  is  incorporated  in  the  algorithms  through  the  Lexicographical  Evaluation 
Functional  with  tolerances  (LEFj  [Nlichalski,  1980b},  explained  in  chapters  5  and  6. 

Another  use  of  background  knowledge  is  to  help  determine  which  features  are  relevant  to 
the  classification  problem.  Event  descriptors  can  be  divided  into  initial  descriptors  and  derived 
descriptors.  The  initial  descriptors  can  be  further  divided  into  those  that  are  relevant  and  those 
that  are  irrelevant  to  the  problem.  In  some  problems,  the  complete  set  of  relevant  descriptors  is 
unknown  and  not  necessarily  provided  as  initial  descriptors.  A  solution  can  still  be  obtained  in 
such  cases  if  background  knowledge  can  be  used  to  derive  relevant  descriptors  from  those  that 
are  initially  given.  When  considering  both  initial  and  derived  descriptors,  it  is  possible  to 
distinguish  three  categories  of  descriptors,  as  given  below. 

Initial  descriptors 

Initial  descriptors  are  those  predicates  and  attributes  of  objects  and  object  subparts  that 
are  present  in  the  given  object  descriptions.  For  physical  objects  the  descriptors  will  be 
size,  color,  location,  connectivity  relationships  for  object  subparts,  etc 

Descriptors  derived  by  logical  Inference 

These  descriptors  are  predicates  and  functions  obtained  by  the  application  of  general  and 
problem-specific  inference  rules  to  the  initial  descriptions  of  the  objects.  In  this  work, 
inference  rules  consist  of  a  condition  part  and  a  consequence  part.  Whenever  an  object 
description  matches  the  condition  portion  of  a  rule,  the  consequence  portion  is  applied  to 


the  object  description  The  consequence  may  be  composed  of  new  predicates  and  functions 
to  be  asserted  or  arithmetic  expressions  that  are  evaluated.  In  both  cases,  the  new 
descriptors  (unless  already  present)  are  appended  to  the  object  description  and  become 
available  as  attributes  that  are  potentially  relevant  for  building  classifications  of  the 
objects. 

Descriptors  derived  by  special  computations,  experiments  or  devices 

These  descriptors  are  obtained  from  the  initial  descriptors  by  the  application  of  specialized 
descriptor  generation  procedures,  by  running  experiments,  or  by  activating  some  external 
device.  Examples  of  such  descriptors  include  “the  number  of  object  subparts,"  “the 
number  of  subparts  with  some  specific  property,"  “the  number  of  different  values  observed 
for  an  attribute,"  and  “properties  common  to  all  subparts." 

et  us  consider  3  simple  example.  Suppose  that  we  are  observing  a  typical  restaurant  table  on 
vhich  there  are  such  objects  as  food  on  a  plate,  a  salad,  utensils,  salt  and  pepper,  napkins,  a 
ase  with  flowers,  a  lamp,  etc.  Suppose  a  person  is  asked  to  build  a  meaningful  classification  of 
he  objects  on  the  table.  One  way  to  create  a  classification  is  to  perform  the  following  chains  of 
'iferences: 

•  salt  and  pepper  are  seasonings 
seasonings  are  added  to  food 
seasoned  food  is  something  to  be  eaten 
things  which  are  to  be  eaten  are  edible 
salt  and  pepper  are  edible 

•  salad  is  a  vegetable 
vegetables  are  food 

food  is  something  to  be  eaten 
things  which  are  to  be  eaten  are  edible 
salad  is  edible 

.  similar  chain  of  inferences  applied  to  “meat  on  a  plate"  or  “cake  on  3  dessert  plate"  will  also 
ad  to  the  concept  “edible."  On  the  other  hand,  a  lamp  is  not  food  and  is  therefore  not  edible 
vase  containing  flowers  is  not  food  and  is  therefore  not  edible.  Consequently,  with  the  aid  of 


pertinent  background  knowledge  inference  rules,  one  meaningful  classification  of  objects  on  the 
table  is  the  division  of  objects  according  to  the  classifier  “edible  vs.  inedible." 

The  problem  this  example  poses  is  this:  suppose  we  are  given  descriptions  of  objects  on  the 
table  in  terms  of  their  physical  attributes  and  we  want  to  have  the  program  create,  on  the  basis 
of  these  descriptions,  the  above  classification  of  edible  and  inedible  objects  Such  a  classification 
based  solely  on  original  attributes  is  quite  unlikely,  since  neither  the  “edible"  predicate  nor  any 
equivalent  attribute  is  an  easily  observed  physical  attribute  of  an  object.  It  is  necessary  to 
derive  descriptors  such  as  “edible"  using  available  background  knowledge.  A  program  that 
could  classify  objects  on  a  table  as  edible  or  inedible  would  have  to  be  equipped  with  (among 
other  things)  the  above  inference  rules  and  with  the  ability  to  use  them. 

3.7.  Special  cluttering  situations 

One-dimensional  clustering 

A  special  situation  exists  in  the  case  of  one-dimensional  conceptual  clustering.  When 
clustering  the  values  of  a  single  attribute,  the  resulting  concepts  must  be  generalized  values  in 
the  domain  of  the  attribute  (e  g.,  intervals  in  the  case  of  a  linearly  ordered  domain).  For  some 
attribute  domains,  background  knowledge  describing  preferred  generalization  transformations 
can  be  brought  to  bear  on  the  problem.  For  example,  the  attribute  shape  may  have  a  domain 
containing  the  values  square,  triangle,  circle,  ellipse,  and  a  generalization  hierarchy  that 
provides  polygon  as  a  generalization  of  square  and  triangle,  and  curved  as  a  generalization  of 
circle  and  ellipse.  This  type  of  generalization  transformation  is  called  climbing  the  value 
hierarchy.  It  will  be  discussed  again  in  Chapter  -4 

Clustering  repeatedly  occurring  or  weighted  examples 

In  some  situations,  objects  in  a  collection  are  not  considered  equally  important.  Such 
differences  in  objects  are  relevant  when  building  a  classification  that  tries  to  reveal  strong 


patterns  in  the  data.  Certain  object  descriptions,  which  occur  repeatedly  in  the  collection  when 
others  occur  only  once,  should  be  treated  differently  Furthermore,  since  repeating  objects  are 
conceptually  identical,  it  is  not  necessary  to  consider  them  more  than  once.  Thus,  multiple 
occurrences  of  objects  are  merged  into  one  object  with  appropriately  increased  importance.  This 
notion  of  importance  is  handled  by  assigning  to  each  object  a  unit  weight t2  and  by  automatically 
editing  each  collection  of  objects  to  eliminate  duplicates  and  arithmetically  combine  weights. 
The  use  of  object  weights  in  the  evaluation  of  the  degree  of  fit  between  a  set  of  objects  and  an 
associated  concept  is  discussed  in  Chapter  5. 

Clustering  with  negative  examples 

Building  a  classification  by  conceptual  clustering  is  normally  an  unsupervised  process 
(without  a  teacher).  A  variation  of  the  basic  method  can  utilize  a  teacher  that  circumscribes  the 
the  collection  of  entities  being  classified  with  well-chosen  negative  examples.  The  goal  of 
classification  building  in  such  a  situation  is  to  find  a  set  of  concepts  which  form  a  classification 
for  the  positive  examples  and  which  do  not  cover  any  negative  examples.  For  example,  if  one 
were  creating  a  classification  of  automobiles,  a  teacher  could  guide  the  process  away  from 
building  classes  that  might  also  cover  trucks  by  providing  some  examples  of  trucks  as  negative 
examples  to  the  classification  building  process. 


;  Provision  cun  bo  made  for  arbitrary  user-defined  initial  weights  for  each  object  rather  than  unit  weights 
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CHAPTER  4 

CLASSIFICATION  BUILDING  AS  INDUCTIVE  INFERENCE 


This  chapter  presents  conceptual  classification  building  as  a  process  of  inductive  inference. 
In  Chapter  3  the  general  algorithm  of  dynamic  clustering  was  presented.  A  different  view  of  the 
clustering  process  is  outlined  in  Fig.  4.1.  This  view  presents  conceptual  clustering  as  a  process  of 
repeated  discrimination,  i.e.,  repeated  application  of  inductive  inference  in  the  form  of  learning 
from  examples.  In  order  to  apply  inductive  inference  techniques,  a  representation  scheme  for 
both  examples  and  classes  of  examples  is  needed  which  supports  a  wide  variety  of  generalizing 
and  specializing  transformations.  This  chapter  presents  a  framework  for  conceptual  clustering 


Given:  k,  the  number  of  clusters  desired 

E,  the  collection  of  observed  examples 
B,  the  available  background  knowledge 
H,  the  classification  goal 
S,  the  stopping  criterion  or  resource  limit 


Apply  background  knowledge  B  to  examples  E. 

Repeat  until  stopping  criterion  S  is  met. 

Form  a  partial  partition  hypothesis  by  assigning 
one  or  more  examples  (seeds)  to  each  of  k  classes. 

Use  inductive  inference  (learning  by  examples) 
to  generate  class  descriptions  which  optimize 
the  classification  goal  H. 

Figure  4.1.  The  basic  conceptual  clustering  algorithm  of  repeated  discrimination. 


based  od  inductive  inference  techniques.  The  method  used  has  some  similarity  to  dynamic 
clustering  but  is  carried  out  by  applying  inductive  learning  algorithms  and  transformations  to 
examples  described  using  a  representation  scheme  based  on  propositional  logic  and  predicate 
calculus. 

The  three  sections  of  the  chapter  describe  the  inference  framework  with  respect  to  an 
associated  representation  language,  some  useful  generalizing  and  specializing  transformations, 
and  a  process  for  building  classifications  by  repeated  discrimination.  This  framework  for 
inference-based  conceptual  clustering  is  used  later  to  build  three  methods  for  generating 
classifications.  The  inductive  inference  techniques  of  this  chapter  used  with  an  extended 
propositional  logic  representation  (i.e.,  attribute/value-set  pairs)  form  the  basis  for  the  method 
presented  in  Chapter  5  for  building  classifications  of  unstructured  examples  described  by  vectors 
of  attribute  values.  The  same  inductive  inference  techniques  combined  with  an  extended 
predicate  calculus  representation  form  the  basis  for  the  method  presented  in  Chapter  6  for 
building  classifications  of  structured  examples  represented  by  statements  in  predicate  calculus. 
A  combination  of  the  two  methods  is  presented  in  Chapter  7.  That  method  uses  a  structural 
template  to  transform  a  problem  with  structured  examples  into  derived  subproblems  with 
unstructured  examples. 

4.1.  Problems  of  partitioning 

The  problem  of  how  to  build  a  classification  for  a  collection  of  objects  is  decomposed  into 
two  parts,  “how  many  classes  (clusters)  are  best?"  and  “what  are  the  class  descriptions?"  Both 
questions  are  to  be  answered  with  respect  to  the  classification  goal.  Since  class  descriptions 
cannot  be  obtained  until  the  number  of  classes  is  known,  and  since  choosing  the  optimal  number 
of  classes  requires  the  ability  to  evaluate  the  classifications  produced  (as  determined  by  class 
descriptions),  there  is  no  straightforward  way  to  answer  both  questions  optimally 
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A  tractable  approach  is  to  evaluate  and  compare  the  best  classifications  produced  for  a 
range  of  numbers  of  classes.  Let  the  minimum  and  maximum  numbers  of  classes  be  k  ,  and 
km.v,  respectively.  For  each  value  of  k  between  k^  and  k  ,  the  best  classification  involving  k 
classes  is  determined.  The  value  of  k  associated  with  the  best  overall  classification  determines 
the  optimal  number  of  classes  to  form. 

By  constraining  k  to  lie  between  k^  and  k^  (with  k^  and  k^  fixed  arbitrarily)  it  is  no 
longer  possible  to  generate  the  optimal  classification  if  the  best  value  for  k  happens  to  lie  outside 
the  interval  considered.  By  constructing  a  hierarchical  classification  rather  than  a  one-level 
classification,  k^  can  remain  small  and  yet  an  unlimited  number  of  classes  may  be  defined  as 
leaves  in  the  hierarchy  with  only  k^  branching  at  each  level.  The  k^  branching  constraint  of 
the  hierarchical  classification  may  for  some  problems  preclude  the  construction  of  the  optimal 
classification. 

Let  us  presume  the  above  approach  for  finding  the  optimized  value  for  k.  The  remaining 
task  is  to  generate,  for  each  trial  value  of  k,  the  classification  involving  k  classes  that  optimizes 
the  classification  goal.  The  procedure  to  do  this  involves  iterative  inductive  inference  of 
repeated  discrimination  (repeated  learning  from  examples). 

To  see  how  this  works  philosophically,  keep  in  mind  that  the  result  is  a  set  of  k  generalized 
descriptions  that  are  mutually  disjoint,  cover  all  positive  examples  in  the  collection,  and  are 
optimal  (or  near  optimal)  with  respect  to  the  classification  goal.  Because  the  descriptions  are 
mutually  disjoint,  they  can  be  used  to  partition  the  objects  into  k  object  classes,  such  that  the 
ith  description  covers  only  objects  in  the  ith  class. 

Now  suppose  the  correct  partition  exists  but  that  the  class  descriptions  are  unknown.  This 

is  the  traditional  learning  from  examples  problem1  in  which  there  are  k  classes  and  it  is  desired 

to  find  k  optimized  discriminant  descriptions  for  the  classes.  Procedures  to  produce  such  (juasi- 

1  Actually,  i  modified  learning  from  examples  paradigm  is  used  that  r-nerates  e Isu  dcucnption  rules  The  regular 
paradigm  of  learning  from  examples  generates  rules  of  the  more  general  c(as«  recognition  type 
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optimal  discriminant  descriptions  are  well  known  [Michalski,  1980a,  1983].  Getting  the  partition 
of  objects  that  optimizes  the  classification  goal  remains  the  crux  of  the  matter. 

Finding  the  correct  partition  is  computationally  difficult  because  there  are  so  many 
possible  partitionings  of  m  objects  into  k  classes.  The  generate-and-test  approach  cannot 
succeed  in  cases  such  as  this  unless  only  a  tiny  subset  of  possible  partitionings  are  investigated. 
Unfortunately,  heuristics  to  select  partitionings  likely  to  score  well  with  respect  to  the 
classification  goal  are  unknown. 

One  solution  to  the  partitioning  problem  comes  from  inductive  inference.  Remember  that 
a  partition  of  the  objects  is  being  sought  in  order  to  use  a  learning  from  examples  approach  to 
generate  class  descriptions.  Learning  from  examples  is  a  robust  procedure  that  can  produce 
nearly  correct  class  descriptions  from  incomplete  sets  of  examples.  This  property  can  be  used 
here  to  help  partition  the  objects  into  classes. 

If  a  partioning  of  the  objects  were  available,  the  objects  in  one  group  would  constitute  a 
set  of  examples  of  a  class  and  the  union  of  examples  in  other  groups  would  constitute  negative 
examples  of  the  class.  An  application  of  the  paradigm  of  learning  from  examples  would  generate 
a  description  of  the  class  covering  all  (positive)  examples  and  no  negative  ones.  The  above 
procedure  would  be  performed  a  total  of  k  times  to  generate  descriptions  for  each  class,  with  a 
different  group  in  the  partition  constituting  the  positive  example  set  on  each  iteration. 

Suppose  instead,  that  only  k  objects  (called  seeds)  are  used,  one  selected  somehow  from 
each  class.  A  single  object  in  one  class  would  be  the  only  positive  example  while  the  k-1  seed 
objects  in  the  other  classes  would  form  the  set  of  negative  examples.  When  learning  from 
examples  is  applied  in  this  situation,  the  resulting  descriptions  will  likely  be  more  general  than 
before  when  all  examples  were  used  because  there  are  fewer  negative  events.  Strong  patterns  in 
the  collection  of  objects  will  still  emerge  in  the  generated  class  descriptions  because  each  class 


continues  to  be  represented  by  one  example. 


The  above  seed-based  approach  is  actually  run  in  reverse.  If  k  examples  can  be  selected 
such  that  each  example  comes  from  a  different  one  of  the  (unknown)  classes  that  are  optimal 
with  respect  to  the  classification  goal,  then  the  generated  class  descriptions  should,  in  a 
generalized  way,  reveal  the  class  structure.  The  algorithm  is  shown  in  Fig.  4.1.  The  hard  part  is 
the  selection  of  seed  objects. 

The  desired  result  of  such  an  algorithm  is  a  conceptual  clustering  (a  partitioning  of  all 
objects  with  corresponding  disjoint  class  descriptions)  that  optimizes  the  classification  goal  in  the 
special  situation  that  the  seed  examples  are  “correctly"  selected,  one  from  each  class.  Of  course 
the  “correct"  choice  of  seed  examples  is  unknown.  Selection  heuristics  based  on  the  previous 
hypothetical  partitioning  have  been  designed,  based  on  the  dynamic  clustering  method  described 
in  Chapter  3.  Repeated  application  of  the  inner  loop  of  the  algorithm  (Fig.  4.1.)  using  the 
selection  heuristic  tends  to  select  improving  choices  of  seed  examples,  and  hence,  better 
conceptual  clusterings.  With  a  stopping  criterion  to  limit  the  expenditure  of  computational 
resources,  near  optimal  class  descriptions  are  generated.  Further  details  of  this  method  are 
given  later  in  Sec.  4.4. 

The  heart  of  the  above  process  is  inductive  inference  over  descriptions  of  examples.  This 
implies  having  a  suitable  underlying  representation  language  and  associated  generalization 
transformations. 

4.2.  Representation  language 

In  order  to  build  a  classification  of  objects,  it  is  necessary  to  have  an  adequate  language  for 
describing  objects  as  well  as  classes  of  objects.  This  requirement  suggests  the  use  of  a  predicate 
calculus  or  some  modification  of  it.  Here,  a  language  created  by  Michaiski  [1983]  called 
Annotate d  Predicate  Calculus  (APCj  is  used  APC  is  an  extension  of  predicate  calculus  that 
uses  several  novel  forms  and  attaches  an  annotation  to  each  predicate,  variable,  3nd  function. 
The  annotation  is  a  store  of  information  about  the  given  predicate  or  atomic  function  such  as 


the  definition  of  the  function's  value  set.  In  addition  to  all  forms  found  in  predicate  calculus, 
the  APC  language  also  employs  a  special  kind  of  predicate  called  a  selector.  A  simple  selector  is 
in  the  form: 

[atomic-function  REL  value-of-atomic-function] 
where  REL  (relation)  stands  for  one  of  the  symbols  =  ^  <  >  S  a.  An  example  of  such  a 
selector  is 

(weight(box)  >  2kgj 

which  means  “the  weight  of  the  box  is  greater  than  2  kg.”  “Box"  is  the  argument  (often 
existentially  quantified)  of  the  single-argument  function  “weight.”  For  multi-argument  functions 
and  predicates,  the  notation  f(a,b,c,  ...)  is  used  to  denote  a  function  having  positional  significance 
of  its  arguments.  When  argument  position  is  irrelevant,  the  notation  f(a.b.c.  ...)  is  used.  With 
two-place  predicates,  the  notation  p(a.b)  denotes  an  3nti-symmetric  predicate  while  p(a.b) 
denotes  a  symmetric  predicate  for  which  p(a.b)  ■  p(b.a). 

A  more  complex  selector  may  involve  internal  disjunction  or  internal  conjunction.  These 
two  operators  apply  to  terms  rather  than  to  predicates  and  are  illustrated  by  the  two 
corresponding  examples: 

[color(box)  =  red  V  purple]  “the  color  of  the  box  is  either  red  or  purple." 

[color(boxl  &  box2)  =  red]  “the  color  of  boxl  and  box  2  is  red.” 

The  meaning  of  the  internal  disjunction  operator  is  defined  by 

(f(x)=a  V  b]  <*=£>  [f(x)=a]  V  [f(x)=b] 
and  the  meaning  of  the  internal  conjunction  operator  is  defined  by 

[f(x  &  y)=a|  <$=£>  |f(x)=a]  &  [f(y)=a]. 

Selectors  can  be  combined  by  standard  logical  operators  to  form  more  complex  expressions. 

Background  knowledge  can  be  expressed  as  a  set  of  APC  implicative  rules: 

CONDITION  =S>  CONSEQUENCE 

where  CONDITION  and  CONSEQUENCE  are  conjunctions  of  selectors.  If  CONDITION  is 


satisfied,  then  CONSEQUENCE  is  asserted.  To  illustrate  the  implicative  statement,  consider 
the  assertion  “vegetables  are  food”  from  the  example  in  Chapter  3.  It  can  be  expressed: 

(is-vegetable(objectl)j  =£>  (is-food(objectl)j 
An  alternative  way  to  express  it  is 

[type(objectl)  =  vegetable)  =£>  [type(objectl)  =  food] 

In  this  latter  expression  “vegetable”  and  “food"  are  treated  as  elements  of  the  tree-structured 
domain  of  the  attribute  “type."  This  implication  expresses  a  generalization  inference  rule  called 
climbing  the  generalization  hierarchy  (the  domain  of  the  attribute  “type”  is  assumed  to  have  a 
tree  structure).  Further  details  on  the  APC  language  are  given  in  [Michalski,  1983] . 

A  conjunctive  statement  in  APC  can  describe  conceptually  a  single  example,  or  a  class  of 
examples,  depending  on  its  generality  An  equivalent  view  of  such  a  conjunctive  statement  is  as 
a  cover  for  some  part  of  the  feature  space  in  which  all  examples  are  described  (This  space  is 
called  the  event  space.)  A  statement  describing  a  single  example  covers  (is  satisfied  by)  only  one 
point  in  the  space.  A  more  general  statement  would  cover  (be  satisfied  by)  many  points. 
Covered  points  that  correspond  to  given  examples  are  called  observed  events.  Points  which  have 
no  corresponding  example  in  the  given  collection  of  examples  are  called  unobserved  events.  For 
a  given  set  of  observed  events,  the  best  fitting  statement  that  covers  the  events  with  minimal 
generality  is  the  one  that  covers  the  fewest  unobserved  events. 

A  class  of  examples  can  thus  be  defined  in  two  equivalent  ways.  One  way  is  by  giving  a 
set-theoretic  enumeration  of  all  events  (both  observed  and  unobserved)  that  are  in  the  class. 
The  other  way  is  by  giving  a  conjunctive  statement  that  is  formulated  such  that  it  is  satisfied 
only  by  examples  in  the  class.  This  dual  interpretation  does  not  hold  for  all  possible 
arrangements  of  examples  since  not  all  combinations  of  events  can  be  described  precisely  by  a 
single  conjunctive  statement. 

Given  any  set  of  examples  (observed  events),  covering  theory  shows  that  there  exists  a 
conjunctive  cover  of  the  entire  set  of  observed  events  in  all  cases  only  if  it  is  permissible  to  cover 


some  additional  unobserved  events  [Michalski,  197 4j .  Such  a  cover  is  called  a  complex.  It  is  a 
dual  form  entity  that  has  both  logical  and  set-theoretic  properties.  A  complex  is  written  as  an 
APC  conjunctive2  statement.  The  logical  interpretation  of  a  complex  is  a  conceptual  description 
that  is  satisfied  by  all  examples  in  its  concept  class.  The  set-theoretic  interpretation  of  a 
complex  is  a  subset  of  points  in  the  event  space.  Any  examples  represented  by  a  point  in  the 
covered  subset  belong  in  the  described  class. 

A  complex  differs  from  an  arbitrary  class  of  examples  (an  arbitrary  collection  of  points  in 
the  event  space)  in  that  a  complex  always  supports  dual  interpretations,  i.e.,  an  equivalent 
conjunctive-form  APC  statement  is  always  available.  The  notion  of  a  complex  will  be  useful 
when  it  is  desirable  to  talk  about  only  those  subsets  of  points  (examples)  in  the  event  space  for 
which  there  exists  an  equivalent  conjunctive-form  APC  statement.  The  term  (■ complex 
explicitly  denotes  the  logical  interpretation  of  a  complex  while  the  term  s-complex  explicitly 
denotes  the  set-theoretic  interpretation.  Both  interpretations  are  implied  simultaneously  by  the 
term  complex  without  a  prefix. 

4.3.  Representation  transformations 

The  process  of  conceptual  clustering  (as  presented  here)  can  be  described  as  a 
transformation  from  descriptions  of  objects  as  points  in  a  multi-dimensional  event  space  to 
descriptions  of  classes  of  objects  described  in  a  one-dimensional  does  space  There  will  be  k  such 

classes  that  can  be  labeled  C,,  C„ . C..  It  is  assumed  here  that  the  classes  are  described  bv 

conjunctive  statements  otr  a„ ak.  A  conjunctive  statement  a.  containing  p.  conjuncts  has  the 

form 

“r  Su  A  Si2  A  -  A  Sip.,  <==i>  Ci 

Concept  C.  is  defined  by  the  conjunction  of  properties  S.j,  where  the  S  units  are  selectors  in 
APC. 

2  A  conjunctive-form  statement  may  contain  selectors  that  employ  internal  conjunction  and  internal  disjunction  A 
conjunctive-form  statement  may  not  involve  the  (external)  disjunction  of  selectors 


When  al!  a.  are  mutually  disjoint,  each  a.  describes  a  transformation  from  p.-space  into 
class  space.  Normally,  a  problem  is  not  originally  stated  in  p^space  and  many  other 
transformations  are  applied  to  go  from  the  initial  representation  space  to  p-space  Some 
transformations  may  reduce  the  dimensionality  of  the  description  space;  others  may  reduce  the 
number  of  relevant  values  along  some  dimension;  some  transformations  may  construct  one  set  of 
descriptors  (dimensions)  from  another.  Although  there  are  set  theoretic  interpretations  to  all 
transformations  used,  it  is  the  conceptual  interpretation  within  the  APC  representation  language 
that  is  most  interesting.  Many  such  transformations  are  described  below.  Most  of  these 
transformations  (inference  rules)  were  developed  by  Michalski  [1983], 

Dimension-reducing  transformations  (generalizing  transformations) 

•  Dropping  condition  rule:  a  conjunctive  description  can  be  generalized  by  removing  one  or 
more  conjuncts 

Relevant  value  set  transformations  (generalizing  transformations) 

•  Adding  alternative  value  rule:  a  selector  conjunct  [f(x)=a|  can  be  generalized  by  adding 
one  additional  value  b  (or  more)  in  order  to  form  the  selector  [f(x)=aVbj.  The  composite 
value  “aVb'’  replaces  the  values  “a'  3nd  ‘b"  and  thus  reduces  the  range  of  possible  values 
for  function  f. 

•  Closing  the  interval  rule:  if  the  domain  of  function  f  is  linear  (ordered)  and  a  selector 
conjunct  is  in  the  form  [f(x)=aVb|  then  the  value  set  can  be  generalized  to  the  closed 
interval  [a.bj  that  is  written  in  APC  as  (f(x)=a..bj.  The  composite  value  “a..b”  replaces  all 
values  from  a  to  b  in  the  domain  of  f. 

•  Climbing  value  hierarchy  rule:  if  the  function  f  is  annotated  with  a  value  hierarchy  (or  if 
one  can  be  inferred  from  background  knowledge)  then  a  selector  conjunct  of  the  form 
jf(x)=aVbVc...j  can  have  its  value  list  generalized  to  a  more  general  value  g  in  the 
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hierarchy  if  values  a.b.c,. ..  are  all  special  cases  of  value  g.  For  example,  in  the  value 
hierarchy  shape  shown  in  Fig.  4.2.,  the  value  polygon  is  a  generalization  of  the  values 
triangle,  square,  rectangle.  The  value  polygon  can  replace  a  disjunction  of  two  or  more 
values  that  lie  below  it  in  the  hierarchy. 

Descriptor  construction  transformations  (specializing  transformations) 

•  Counting  quantified  variables  rule:  in  an  APC  statement,  quantified  variables  are 
annotated  with  a  symbol  denoting  a  quantified  variable  equivalence  class.  For  example,  in 
a  blocks-world  problem  involving  boxes  and  objects  such  as  a  situation  described  by 
3  boxl,box2,objectl,  |ontop(box2,boxl)j[in(objectl,box2)| 
some  quantified  variables  belong  to  the  variable  class  boxes  (e  g.,  boxl,box2)  and  others 
belong  the  the  variable  class  objects  (e  g.,  objectl).  The  counting  quantified  variables  rule 
constructs  a  selector  that  specifies  the  number  of  distinct  quantified  variables  of  each 
variable  class  present  in  a  description.  In  the  blocks-world  situation  above,  the  two 
selectors  constructed  are  [#boxes=2j  and  [#objects=l],  read  “the  number  of  boxes  is  2” 


and  "the  number  of  objects  is  1."  respectively  They  are  conjoined  to  the  original  APC 
expression  to  yield 

3  box l,box2, object  1,  (ontop(box2,boxl)j[in(objectl,box2))[#boxes=2][#objects=l|. 

Counting  similar  selectors  rule:  sometimes  two  or  more  selectors  are  conjoined  and  are 
identical  except  for  quantified  variable.  For  example  (continuing  with  bloclcs-world 
situations)  consider  the  statement 

3  boxl,box2,  [color(boxl)=redj[color(box2)=red]. 

The  counting  similar  selectors  rule  constructs  a  selector  to  indicate  athere  are  two  boxes 
that  are  red."  This  is  written  in  APC  as  [#boxes(color=red)=2],  with  the  general  form 
[#  <variable  class>  (  <property>  )=  <count>). 

Counting  distinct  values  rule;  this  rule  constructs  a  selector  for  each  function  domain 
indicating  the  number  of  distinct  values  in  the  domain  which  appear  as  values  in  the  APC 
statement.  For  example,  in  the  statement 

3  boxl,box2,  [color(boxl)=red][size(boxl)=smallj[color(box2)=red][size(box2)=large) 
the  constructed  selectors  that  will  be  conjoined  are 

{#di(T-colors=l][#diff-sizes=2). 

Universal  properties  rule:  a  “forall"  predicate  is  constructed  when  all  functions  of 
quantified  variables  from  the  same  variable  class  appear  with  the  same  values.  For 
example  in  the  statement 

3  boxl,box2,box3,  [color(boxl)=red][color(box2)=red][color(box3)=red] 
all  boxes  boxl,box'2,box3  have  the  property  “color=red"  which  is  denoted  by  conjoining 
the  constructed  selector  (forall-boxes(color=red)j.  Such  selectors  have  the  form 
[forall- < variable  class >  (  <property>  )]  if  true,  or 

[fora!l-<variable  class>  (  <property>  )  =  FALSE]  if  false. 
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•  Generating  chain  properties  rule:  two-place  anti-symmetric5  predicates  (e  g.,  ontop)  may 
form  chains  of  relationships  such  as  [ontop(A,B)j[ontop(B,C)].  in  such  chains,  there  are 
extreme  elements  (denoted  by  two  different  quantified  variables)  at  the  ends  of  the  chain. 
Let  one  quantified  variable  denote  the  “most-”  end  of  the  chain  and  let  the  other 
quantified  variable  denote  the  “least-”  end.  The  chain  properties  rule  constructs  “most-" 
and  “least-”  predicates  to  denote  the  ends  of  the  chain  For  the  above  example,  the 
additional  selectors  would  be  (MOST-ontop(A)]  and  [LEAST-ontop(C)]. 

•  Generating  equivalence  relations  rule:  when  two  or  more  different  quantified  variables 
appear  with  the  same  function  symbol  and  values,  the  entities  are  equivalent  with  respect 
to  that  function.  Consider  the  statement 

3  boxl.box2,box3,  (color(boxl )=red|[color(box2)=redl[color(box3)=blue|. 

The  quantified  variables  boxl  and  box2  have  the  same  color  function  value  (red).  An 


equivalence  selector  is  constructed  as  |SAME-color(boxl.box2)].  The  dot  is  used  to  delimit 
variables  to  denote  symmetry  (i.e.,  jSAME-color(boxl.box2)|  ■  [SAME-color(box2.boxl  )|). 

•  Applying  background  inferences:  background  knowledge  is  supplied  in  the  form  of  APC 
inference  rules  (CONDITION  =3>  CONSEQUENCE,  where  the  consequence  is  a 
conjunction  of  selectors).  Whenever  a  description  satisfies  the  CONDITION  part  of  a 
background  rule,  the  CONSEQUENCE  selectors  are  conjoined  to  the  description  (unless 
they  are  already  present). 

•  Using  special  computations,  experiments  or  devices:  under  special  circumstances  new 


descriptors  can  be  obtained  by  performing  certain  computations  (e  g.,  by  the  simulation  of 
some  process),  by  directing  an  automated  experiment  using  computer-controlled  apparatus, 

3  The  predicate  ontop(A.B)  is  anti-symmetric  if  ontop(A.B)  does  not  imply  ontop(B.A)  For  constructing  chain  pro¬ 
perties.  it  is  the  property  of  transitivity  rather  than  anti-symmetry  that  is  actually  important  In  the  implementation 
of  the  ‘generating  chain  properties  rule'  the  assumption  is  made  that  anti-symmetric  predicates  are  also  transitive 
This  assumption  reflects  the  expressiveness  of  the  APC  language  which  can  denote  symmetric  vs  anti-symmetric 
predicates  but  has  no  notation  to  differentiate  transitive  from  intransitive  ones  This  approach  can  lead  to  potential 
(though  minor)  difficulties 
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or  by  acquiring  data  directly  from  sensing  devices  The  implementations  discussed  in  the 

thesis  do  not  make  use  of  these  kinds  of  descriptor  construction  transformations. 

4.4.  Building  classifications  by  repeated  discrimination 

The  process  of  generating  a  hypothetical  classification  composed  of  k  conceptual  classes 
when  given  k  seed  objects  is  embodied  in  the  algorithm  CONCEPTL’ALIZE-SEEDS  given  in  Fig. 
4  3  The  algorithm  works  in  parallel  on  ail  k  seeds  by  applying  the  inductive  inference  learning 
paradigm  of  learning  from  examples  to  k  different  positive  example  sets  (each  containing  one 
unique  seed  object)  and  corresponding  negative  example  sets  containing  the  other  k-1  objects 

Given  are  the  examples  (observed  events)  to  be  classified,  the  currently  selected  seed 
examples,  the  classification  goal,  and  a  search  limit  The  algorithm  begins  by  generating  k  stars 

GfejFj),  i*«  1,2 k.  Each  such  star  is  the  set  of  all  maximal-under-inclusion  complexes  which 

cover  event  e(  and  none  of  the  events  in  the  against  set  F,  [Michalski,  197t|.  The  sets  F,  are 
constructed  to  contain  all  seed  events  except  er  Thus,  the  set  g  asGfe.lF,)  contains  class 
descriptions  that  describe  (cover)  seed  et  and  perhaps  other  events  in  set  E  but  not  any  other 
seed. 

This  generates  conceptual  “localities'  that  are  combined,  made  disjoint,  and  become 
hypothetical  classifications,  as  described  below.  The  classifications  generated  by  considering 
different  combinations  of  complexes  are  evaluated  according  to  the  classification  goal  and  the 
best  classification  is  retained  It  is  output  when  the  search  limit  is  reached. 

A  preliminary  step  of  the  classification  building  procedure  is  to  remove  any  duplicate 
examples  in  the  given  collection  of  objects.  Then  each  of  the  conceptual  descriptions  is 
generated  in  the  following  way.  There  is  one  positive  example  for  the  class  being  generated  and 
k-1  negative  examples  of  the  class.  Because  there  are  no  duplicate  examples,  it  is  known  that 
the  positive  example  is  unlike  any  negative  example  This  assures  that  it  is  possible  to  build  k-1 
non-empty  sets  of  generalized  conjunctive  descriptions  that  cover  the  positive  example  and  do 
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Given:  E,  a  collection  of  ovserved  events, 
k  seeds  e1,e„1...,ek  c  E 
H,  the  classification  goat 
L,  the  search  limit 


Let  event  set  Ft  be  {e^e,,...^}  -  {e.}.  Generate  star  g^Gfej  j  F(). 


Repeat  until  limit  L  is  reached 


Using  heuristic  search,  find  a  new  combination  of  k  class  descriptions 
a  ,  a„,...,ak  with  a.cg..  Partition  events  E  according  to  class 
descriptions.  Check  if  class  descriptions  are  mutually  disjoint. 


Descriptions  are  mutually  .. 


Disjoint 


Nondisjoint 


Apply  operation  NID  to  make 
descriptions  disjoint 


Evaluate  clustering  with  respect  to  goal  H.  Save  the  best  clustering 
found  so  far. 


Output  saved  best  clustering. 


Figure  ■1.3.  CONCEPTUALIZE-SEEDS  algorithm. 


•  t  cover  a  unique  negative  example.  When  the  k-1  conjunctive  statements  are  logically 
ij  It  ip  lied  together,  each  hypothetical  conjunctive  description  in  the  resulting  set  covers  the 
■sitive  example  and  none  of  the  negative  examples.  The  classification  goal  evaluation  criterion 
applied  to  the  set  of  hypothetical  descriptions  and  the  best  description  is  selected. 
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4.4.1.  Selecting  seeds 


The  seed  events  focus  the  inductive  inference  process  and  it  is  desirable  that  each  seed 


event  represent  a  strong  pattern  underlying  the  collection  of  events.  Three  selection  procedures 


are  utilized,  under  different  situations. 


In  the  first  iteration,  seed  events  are  selected  randomly  or  arbitrarily.  Such  a  start  is  for 


convenience  and  reflects  the  typical  situation  in  which  nothing  is  known  about  patterns  in  the 


data  a  priori.  Where  background  knowledge  does  contain  such  information,  or  where  statistical 


tests  or  other  conceptual  data  analysis  tools  are  available,  they  can  be  used  to  indicate  plausible 


representative  seed  events  for  the  first  iteration.  In  the  absence  of  knowledge  to  be  used  to 


select  the  initial  seed  events,  the  first  iteration  of  the  algorithm  (which  uses  background 


knowledge  and  the  principle  of  conceptual  cohesiveness  to  fit  concepts  to  the  seeds)  supplies 


some  knowledge  for  selecting  seeds  for  the  second  iteration.  Thus,  the  starting  point  of  the  first 


iteration  is  of  minor  importance  a'd  careful  initial  seed  selection  is  not  crucial  for  good  results 


For  each  subsequent  iteration  of  the  algorithm,  the  last  obtained  result  is  either  better 


than  or  worse  than  its  predecessor.  As  long  as  the  classifications  generated  are  improving. 


concept  focusing  is  enhanced  by  selecting  from  each  class  a  seed  which  is  most  representative  of 


that  class.  Such  an  event  has  the  maximum  number  of  characteristics  in  common  with  the  other 


events  in  that  class.  For  functions  with  values  on  a  linear  (ordinal)  scale,  the  seed  event  should 


take  a  value  for  the  function  which  is  about  average  for  all  events  in  the  class  The  seed  event  is 


selected  by  summing  the  syntactic  distance  between  it  and  all  other  events  in  the  same  class 


(syntactic  distance  is  defined  below). 


When  the  last  result  is  worse  than  the  previous  result,  a  principle  of  adversity  is  practiced. 


I’nder  such  a  principle,  the  representative  event  is  purposefully  selected  to  cause  “trouble."  i.e 


to  severely  test  the  conceptual  cohesiveness  of  the  class.  This  is  done  by  selecting  a  seed  event 


which  is  most  unlike  the  others  in  the  class  (as  measured  by  syntactic  distance)  When  such  a 


selection  is  made,  two  situations  may  develop.  If  the  current  classes  reflect  patterns  of  sufficient 
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strength,  then  any  event  within  a  class  may  be  selected  as  the  representative  without  affecting 
the  class  descriptions  developed  in  the  next  iteration.  Thus,  in  such  a  situation,  the  classification 
would  not  change.  When  the  current  hypothetical  classification  rests  on  patterns  that  are  not 
strong,  the  selection  of  an  extreme  seed  event  will  shift  the  classification  to  an  entirely  new 
partition  of  events  and  associated  class  descriptions.  This  heuristic  operation  encourages  the 
algorithm  to  discover  (explore)  a  new  part  of  the  problem  solution  space  in  the  hope  that  some 
unexplored  classification  there  will  be  better  than  all  others  previously  generated. 

The  implementations  of  the  algorithm  include  a  mechanism  that  records  each  set  of  seeds 
as  they  are  used  in  order  to  prevent  the  duplication  of  selected  seeds  (purely  for  the  sake  of 
efficiency).  For  some  problems  with  just  a  few  events,  it  is  possible  to  exhaust  all  combinations 
of  events  such  that  no  unused  set  of  seed  events  can  be  constructed.  In  such  cases,  iteration 
halts  before  satisfying  the  regular  stopping  criterion. 

The  syntactic  distance  measure  used  to  select  seed  events  is  a  function  8(ere„)  that  is 
computed  by  summing  the  syntactic  distances  between  the  values  of  each  variable  in  the  events 
e,  and  e„.  The  syntactic  distance  between  two  variable  values  is  a  number  from  0  to  1, 
determined  by  a  measure  that  reflects  the  domain  type  of  the  variable  For  a  nominal  variable, 
the  syntactic  distance  is  either  0,  if  the  values  taken  by  the  variable  in  each  event  are  identical, 
or  1,  if  the  values  are  not  identical.  For  a  linear  variable,  the  syntactic  distance  is  the  ratio  of 
the  absolute  difference  between  the  values  to  the  total  span  of  the  value  set  of  the  variable.  For 
a  structured  variable,  the  evaluation  of  syntactic  distance  depends  on  the  type  of  generalization 
hierarchy.  Since  structured  variable  values  in  events  are  leaves  of  a  generalization  hierarchy, 
the  syntactic  distance  between  such  values  for  unordered  and  ordered  hierarchies  is  evaluated 
the  same  way  as  for  nominal  and  linear  variables,  respectively. 


A  note  is  appropriate  to  distinguish  the  syntactic  distance  measure  from  that  of  conceptual 
cohesiveness.  Syntactic  distance  is  a  numerical  function  of  two  ^-complexes  that  sums  (in  the 
special  way  described  above)  differences  in  attribute  values.  It  takes  into  account  the  knowledge 


of  the  domain  of  the  attribute,  but  not  the  fit  of  concepts  to  the  events  It  is  a  good  heuristic 
for  choosing  an  event  which  has  attribute  values  that  are  mostly  typical  of  the  other  events  in 
the  cluster.  Syntactic  distance  is  not  a  good  basis  for  forming  the  clusters  themselves. 
Conceptual  cohesiveness  is  a  good  basis  for  forming  clusters.  Although  the  conceptual 
cohesiveness  between  two  events  is  not  evaluated  in  the  mathematical  sense,  all  events  placed 
into  the  same  class  have  maximal  conceptual  cohesiveness  because  they  are  described  by  the 
same  concept.  Likewise,  events  from  different  classes  have  minimal  conceptual  cohesiveness. 
Thus,  in  present  implementations,  conceptual  cohesiveness  is  not  a  utility  function,  but  is  a 
built-in  bias  of  the  conceptual  clustering  algorithm. 

4.4.2.  Making  concepts  disjoint 

One  disadvantage  of  the  presented  method  is  that  the  class  descriptions  formed  are  not 
necessarily  disjoint,  though  disjoint  classifications  are  frequently  desired  Within  each  class 
described  by  a  non-disjoint  class  description  there  will  be  some  events  which  are  uniquely 
covered  by  the  one  class  and  other  events  which  are  multiply  covered  The  following  algorithm 
called  NID  for  transforming  Non-disjoint  descriptions  Into  Disjoint  ones  is  used  to  adjust  class 
membership  just  enough  to  make  the  classes  and  class  descriptions  disjoint. 

Let  set  M  be  composed  of  all  multiply  covered  events.  By  removing  from  all  classes  all 
events  in  set  M,  and  then  specializing  the  class  descriptions  to  tightly  cover  the  remaining 
events,  a  set  of  disjoint  class  descriptions  will  be  generated.  The  next  step  will  attempt  to  adjust 
class  descriptions  to  again  cover  the  uncovered  events  in  set  M. 

Each  event  in  set  M  is  to  be  assigned  to  a  class,  if  possible.  One  event  e  in  set  M  is  fitted 
to  a  class  by  building  a  class  description  that  covers  all  events  permanently  assigned  to  the  class 
and  event  e,  for  each  class.  Only  one  of  the  k  possible  class  assignments  for  event  e  will  be 
retained,  determined  by  how  well  each  augmented  class  meets  the  classification  goal  criterion 
Once  the  best  class  for  event  e  is  determined,  the  event  becomes  a  permanent  member  of  that 
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class 

4.4.3.  Applying  a  stopping  criterion 

As  the  iterative  algorithm  progresses,  there  is  a  tendency  (introduced  by  the  seed  selection 
technique)  for  the  classification  to  improve.  Improvement  is  not  monotonic,  however,  and 
because  heuristics  are  used  in  virtually  every  operation  to  combat  the  combinatorial  explosion 
that  would  otherwise  occur,  each  part  of  the  algorithm  can  only  proceed  towards  a  quasi-optimal 
result. 

Pecause  each  iteration  can  potentially  lead  to  a  new  “best’’  result  (with  respect  to  the 
classification  goal),  the  temptation  is  to  iterate  forever.  A  simple  formula  is  used  to  balance  the 
expectation  of  improved  results  vs.  the  computational  time  consumed  The  formula  includes  the 
desire  to  produce  not  just  one  single  result  but  several  alternative  results  (remember  that  there 
is  no  ‘‘right’’  answer  in  classification  building).  The  stopping  criterion  is  based  on  two  user- 
supplied  numbers  called  6ase  and  probe.  Base  denotes  the  number  or  alternative  results  desired 
This  number  of  iterations  are  necessary  as  a  minimum  to  ensure  that  sufficient  alternative 
results  exist  to  report,  \fter  base  number  of  iterations,  probe  number  of  additional  iterations 
are  performed.  Probe  indicates  the  width  (in  terms  or  iterations)  of  “voids'  between  local 
optima  which  can  be  bridged.  If  probe  number  of  iterations  are  performed  without  finding  a 
result  better  than  any  of  the  base  number  of  saved  alternative  results,  the  stopping  criterion  is 
met  and  the  algorithm  halts.  Each  time  3  better  classification  is  generated,  it  is  added  to  the 
alternative  classifications  list  after  the  worst  one  in  the  list  is  discarded  and  the  probe  counter 
resets  to  count  another  probe  number  of  iterations.  The  net  effect  is  that  the  algorithm 
continues  towards  the  optimum  result  until  the  iteration  spacing  between  the  next  local 
optimum  and  the  previous  one  exceeds  probe  iterations. 


CHAPTER  5 


METHOD  Is  CLUSTERING  UNSTRUCTURED  OBJECTS 


5.1.  Overall  approach 

This  chapter  presents  the  conjunctive  conceptual  clustering  methodology  sullicient  to 
operate  on  unstructured  objects.  The  input  consists  of  a  collection  of  examples  (and  optional 
negative  examples)  each  described  as  an  event  in  the  form  of  a  complex  which  is  a  vector  of 
attribute  values  (i.e.,  zero-place  functions  and  their  values).  Every  event  has  a  value  for  every 
attribute  The  output  consists  of  a  classification  which  is  a  hierarchy  of  classes  in  which  each 
node  in  the  hierarchy  is  described  by  a  quantifier-free  APC  conjunctive  statement.1  In  the  class 
hierarchy,  all  internal  nodes  branch  into  at  most  k  disjoint  subclasses. 

Background  knowledge  is  a  secondary  input  to  the  conceptual  clustering  process.  In  this 
chapter,  two  kinds  of  background  knowledge  are  considered.  The  first  kind  is  provided  by  the 
APC  variable  annotations.  It  consists  of  the  domain  type  (nominal,  linearly  ordered, 
hierarchically  structured),  the  number  of  values  in  the  domain,  an  optional  cost  of  the  variable, 
and  (for  structured  domains)  the  generalization  hierarchy  of  values.  The  second  kind  of 
background  knowledge  consists  of  optional  APC  implicative  statements,  as  described  in  Sec  l  J 
In  the  method  described  in  this  chapter,  the  implicative  statements  use  only  zero-place  functions 
and  predicates  and  are  quantifier-free 

The  algorithm  consists  of  a  clustering  module  and  a  hierarchy-building  module,  which  are 
described  in  Secs.  5.3  and  5.5.  respectively.  The  clustering  module  is  logically  decomposed  into 
four  main  subalgorithms  which  are  described  for  clarity  in  the  following  section  prior  to  the 
1  This  subset  of  APC  is  the  Variable-valued  Logic  ?ystem  1  (VL.;  Michalski  197-1 
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description  of  whole  clustering  module. 

5.2.  Main  subalgorithms  of  the  eluatering  module 

5.2.1.  Criterion  evaluation 

The  problem  of  how1  to  judge  the  quality  of  a  classification  produced  by  conceptual 
clustering  is  difficult,  and  there  seems  to  be  no  universal  answer  to  it.  One  can,  however, 
indicate  two  major  criteria.  The  first  is  that  descriptions  formulated  for  classes  should  be 
simple,  i.e.,  that  it  be  easy  to  assign  objects  to  classes  and  to  differentiate  between  the  classes. 
This  criterion  alone,  however,  could  lead  to  trivial  and  arbitrary  classifications.  The  second 
criterion  L  that  class  descriptions  should  fit  well  the  actual  data.  To  achieve  a  very  precise  fit, 
however,  a  description  may  have  to  be  complicated.  Consequently,  the  demands  for  simplicity 
and  good  fit  are  conflicting,  and  the  solution  is  to  find  a  balance  between  the  two. 


V 
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A  number  of  other  measures  can  be  introduced  for  evaluating  clustering  quality.  One  can 
use  a  combined  measure  that  includes  any  of  the  following  elementary  criteria: 


The  fit  between  a  classification  and  the  data  is  computed  in  two  different  ways,  denoted  as 
T  and  P.  The  T  measure  is  the  negative  of  the  Total  sparseness  of  the  clustering,  and  the 
P  measure  is  the  negative  of  the  sum  of  the  Projected  sparsenesses  of  the  complexes.  (The 
reason  for  using  the  negative  values  is  to  increase  the  degree  of  match  as  the  sparseness 
decreases.)  The  sparseness  of  a  complex  is  the  number  of  unobserved  events  it  covers.2 
Given  some  events  E  covered  by  complexes  a  and  a',  the  complex  with  the  high  sparseness 
is  the  more  general.  When  good  fit  is  desired,  the  sparseness  should  be  low.  The  Total 
sparseness  is  calculated  when  all  dimensions  of  the  event  space  are  considered  when 
locating  and  counting  the  unobserved  events.  The  Projected  sparseness  is  determined 
when  only  certain  dimensions  corresponding  to  attributes  which  take  different  values  in 


2  When  (vents  are  weighted  the  sparseness  is  computed  as  the  number  of  unobserved  events  plus  the  number  of  ob¬ 
served  events  minus  the  sum  of  the  weights  of  the  observed  events  When  using  weighted  events  it  is  possible  for  the 
sparseoess  to  be  negative 
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two  or  more  class  descriptions  are  used  to  locate  and  count  the  unobserved  events. 

•  The  simplicity  of  a  clustering  is  defined  as  the  negative  of  its  complexity,  which  is  the  sum 
of  costs  attrib  ,t<-d  to  each  selector  present  in  the  complexes.  The  selector  cost  function  is 
based  on  the  number  of  elements  found  in  the  selector’s  value  list  and  a  user-defined  cost 
associated  with  the  function/predicate  symbol.  Selectors  with  few  values  are  less  complex 
than  those  with  many  values,  and  therefore  should  have  a  smaller  cost.  The  cost  function 
for  selector  i  is  calculated  as  (NVL.-l)  +  COSTj,  where  NVLj  is  the  number  of  symbols  in 
the  value  list  of  the  selector  and  COSTj  is  the  cost  associated  with  the  function/predicate 
symbol  used  in  the  selector.  If  not  specified  by  the  user,  COST!  takes  a  default  value  of  1. 

•  The  commonality  of  a  class  description  is  the  number  of  properties  (i.e.,  attribute/value 
pairs)  shared  by  the  events  in  the  class.  The  commonality  is  measured  by  counting  the 

l 

number  of  selectors  that  appear  in  the  class  description.  This  criterion  is  analogous  to  the 
traditional  clustering  criterion  of  maximizing  an  event-to-event  similarity  score  (e  g  , 
number  of  shared  properties)  for  events  within  the  same  cluster. 

•  Inter-cluster  difference  is  measured  by  the  sum  of  the  degrees  of  disjointness  between  every 
pair  of  complexes  in  the  clustering.  The  degree  of  disjointness  or  a  pair  of  complexes  is  the 
number  of  selectors  in  both  complexes  after  removing  selectors  that  intersect  or  that  have 
no  counterpart  containing  the  same  variable  symbol.  For  example,  the  pair  of  complexes: 

\colo  r=rr?d)[size=smallVmedium][shape=cirrle] 

[  color =6/ue][sizp=medium'/large] 

has  the  degree  of  disjointness  '2,  because  2  of  the  5  selectors  intersect  and  the  one  with  the 
variable  shape  has  no  counterpart.  The  disjoint  selectors  are  italicized  This  criterion 
promotes  clusterings  with  classes  having  many  differing  properties,  and  is  analogous  to  the 
criterion  requiring  maximal  distance  between  clusters  used  in  conventional  methods  of 


clustering. 


50 


•  The  discrimination  index  is  the  number  of  variables  that  singly  discriminate  among  all  the 
classes,  i.e.,  variables  having  different  values  in  every  class  description. 


Dimensionality  reduction  is  measured  by  the  difference  between  the  total  number  of 
variables  and  the  essential  dimensionality  defined  as  the  minimum  number  of  variables 
required  to  distinguish  among  ail  complexes  in  a  clustering.  It  can  be  computed  by 
applying  the  variable-valued  logic  minimization  algorithm  Aq  [Micbalski,  1972)  to  the 
clustering.  When  the  discrimination  index  is  greater  than  zero  (i.e.,  when  there  exists  a 
variable  which  singly  discriminates  all  classes)  and  there  are  n  variables,  the  dimensionality 
reduction  achieves  its  maximum  value  of  n-1. 


The  definitions  of  the  above  criteria  are  such  that  the  increase  of  any  criterion  value 
improves  the  quality  of  the  clustering.  The  relative  influence  of  each  criterion  is  specified  using 
the  Lexicographical  Evaluation  Functional  with  tolerances  (LEF)  [Michalski,  1980a|.  The  LEF  is 
defined  by  a  sequence  of  “criterion-tolerance"  pairs  (Cj.tJ,  (c„,t„),  ...,  where  c(  is  an  elementary 
criterion  selected  from  the  above  list,  and  Tj  is  a  “tolerance  threshold"  (t  t  [0...100°c]).  In  the 
first  step,  all  clusterings  are  evaluated  on  the  first  criterion,  Cj,  and  those  that  score  best  or 
within  the  range  defined  by  the  threshold  T(  are  retained.  Next,  the  retained  clusterings  are 
evaluated  on  criterion  c2  with  threshold  T„,  similarly  to  the  above.  This  process  continues  until 
either  the  set  of  retained  clusterings  is  reduced  to  a  singleton  (the  “best"  clustering)  or  the 
sequence  of  criterion-tolerance  pairs  is  exhausted.  In  the  latter  case,  the  retained  clusterings 
have  equivalent  quality  with  respect  to  the  given  LEF,  and  any  one  may  be  chosen  arbitrarily. 
The  selection  of  elementary  criteria,  their  ordering,  and  the  specification  of  tolerances  is  made 
by  a  data  analyst  by  constructing  a  LEF. 


5.2.2.  Generating  a  conceptual  cover  of  events 

A  description  covering  two  or  more  events  and/or  class  descriptions  (complexes)  is 
generated  by  the  REFUNION  operation.  For  each  variable,  the  set  of  all  values  the  variable 
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takes,  in  all  given  events  and  complexes,  is  determined.  These  sets  are  used  as  the  reference 
values  of  the  variable  in  the  generated  complex.  For  example,  given  complexes  describing  two 
events  el  and  e„  and  another  complex  a: 

ei  :  I*1*2|[x2=»3l(x,-0|Ix4-l| 
e,  :  Ix1=0](.x2=2|Ix3=1|(x<=1| 
a  :  |x1=2..3||x2=4J[x3=0]|x4=2| 
the  refunion  complex  REFUNION(e  ,e„,ot)  that  covers  er  e„,  and  a  is 

[x1=0V2V3][x2=2V3V4|[xJ=0Vll[x4=lV2]. 

A  refunion-generated  complex  has  minimum  sparseness  (both  absolute  and  projected)  among  all 
complexes  covering  all  the  given  entities. 

5.2.3.  Generalization  transformations 

All  of  the  generalizing  transformations  introduced  in  Chapter  4  can  be  applied  to 
unstructured  event  descriptions.  This  includes  the  dropping  condition  rule,  the  adding 
alternative  value  rule,  the  closing  the  interval  rule,  and  the  climbing  value  hierarchy  rule.  Two 
descriptor  construction  transformations  can  be  applied  in  the  absence  of  quantified  variables. 
They  are  the  counting  distinct  references  rule,  and  the  applying  background  inferences  rule. 

The  descriptor  construction  transformations  are  applied  to  event  descriptions,  as  described 
in  Chapter  4.  The  generalizing  transformations  are  applied  by  procedure  GENRLIZ.  For 
simplicity,  most  description-generating  operations  (eg,  REFUNION,  REDUSTAR,  etc.)  are 
carried  out  initially  as  if  all  variable  domains  were  nominal  (i.e  ,  not  subjected  to  such 
generalizations  as  closing  the  interval  and  climbing  the  value  hierarchy).  Then  the  GENRLIZ 
procedure  applies  all  generalization  transformations  at  once  and  appropriately  adjusts  reference 
sets  in  the  selectors. 


5.2.4.  Building  a  star 


The  star  G(ejF)  of  event  e  against  event  set  F  (ejiF)  is  the  set  of  all  maximally  general* 
complexes  covering  the  event  e  3nd  not  covering  any  event  in  F.  Informally,  it  is  the  set  of  all 
maximally  general  descriptions  of  event  e  which  do  not  intersect  with  set  F.  Figure  5.1  presents 
a  star  of  event  e  against  events  denoted  by  in  the  two-dimensional  space  spanned  over  linear 
variables  The  star  consists  of  complexes  c^,  a„,  and  a3.  Complex  a'3  is  a  “reduced"  complex 
a3,  as  explained  below. 


complexes  of  the  star 


Figure  5.1.  An  illustration  of  the  star  G(e|F). 


3  A  complex  q  is  mtxur.illy  geoeril  with  respect  to  i  property  P  if  there  does  not  exist  x  complex  a*  with  property 
P  suet  '.hut  a  C  cs* 
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In  the  algorithm  described  in  the  next  section,  the  "‘theoretical’’  stars  (defined  in  the  above 
paragraph)  are  subjected  to  two  major  modifications.  The  first  is  to  minimize  the  sparseness  of 
complexes  in  the  stars,  and  the  second  is  to  “bound"  the  stars,  i.e.,  to  select  from  them  a  certain 
number  of  “best"  complexes,  according  to  a  context-dependent  criterion  The  first  modification 
is  performed  by  algorithm  REDUSTAR,  described  below,  and  the  second  by  algorithm 
BOUNDSTAR  described  in  Sec.  5.4. 

Complexes  in  stars  G(e|F)  are  maximally  general,  and  therefore  may  describe  objects  in  an 
overgeneralized  way.  The  algorithm  REDUSTAR  generates  a  star  and  then  maximally  reduces 
the  sparseness  o*f  each  complex  in  it,  while  preserving  the  coverage  of  observed  events.  For 
example,  complex  ct’3  in  Figure  5.1  is  such  a  reduced  complex  obtained  from  complex  ay  The 
steps  of  the  REDUSTAR  procedure  are: 


(1)  Elementary  stars,  G(e|e.),  e.eF,  are  determined 

To  generate  an  elementary  star  G(e|e.)  of  an  event  e  against  another  event  e.,  all  variables 
that  have  different  values  in  e  than  in  ej  are  identified.  Suppose,  with  no  loss  of  generality,  that 

these  variables  are  x,,x2 xg,  and  that  =  [x1=rj[x2=r=]...(x  =»r  |..,(xB*=rJ.  The  complexes  of 

the  star  G(e|e.)  are  then  [Xj  *  r],  j=l,2 g,  because  these  are  the  maximally  general  complexes 

that  cover  e  and  do  not  cover  e..  The  number  of  complexes  in  an  elementary  star  is  at  most  n, 
and,  because  e^e,  at  least  1. 

(2)  The  complete  star  G(e|F)  Is  determined 

The  star  G(e|F)  is  generated  by  first  setting  up  the  logical  product  A  G°(e|e,),  e.  t  F.  where 

G°(e|e.)  is  the  disjunction  of  complexes  from  the  elementary  star  G(e|e.)  [Michalski,  1974]  The 

I  multiplication  of  complexes  is  performed,  using  absorption  laws,  until  a  disjunction  of 

I 

irredundant  complexes  is  obtained.  This  multiplication  is  carried  out  in  steps,  each  step  being  a 
multiplication  of  a  disjunction  of  complexes  by  a  disjunction  of  selectors  (the  elements  of 

.  t 
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consecutive  elementary  stars).  The  set  of  the  complexes  in  the  resulting  disjunction  is  G(e|F). 


(3)  Complexes  in  G(ejF)  are  reduced  and  simplified 

The  sparseness  of  each  complex  in  the  star  is  reduced  as  much  as  possible  without 
“uncovering"  any  of  the  observed  events.  This  is  done  by  performing  the  REFUNION  of  all  the 
observed  events  contained  in  each  complex.  The  obtained  complexes  are  then  generalized  and 
simplified  by  applying  the  GENRLIZ  operator. 

5.2.5.  NID:  Making  nondisjolnt  complexes  disjoint 

This  procedure  transforms  a  set  of  Nondisjoint  complexes  Into  a  set  of  Disjoint  complexes 
(i.e.,  a  disjoint  clustering).  If  input  complexes  to  NDD  are  already  disjoint,  the  procedure  leaves 
them  unchanged.  The  steps  of  the  procedure  are: 

(1)  ’Core’  complexes  are  determined 

Observed  events  covered  by  more  than  one  complex  from  the  given  set  are  placed  on  the 
multiply-covered  event  list  (m-list).  If  the  m-list  is  empty,  then  the  complexes  are  only  weakly 
intersecting,  i.e.,  the  intersection  area  contains  only  unobserved  events.  In  this  case,  the 
procedure  terminates  with  an  indication  that  the  combination  of  complexes  is  a  weakly 
intersecting  clustering.  Otherwise,  each  complex  is  replaced  by  the  REFUNION  of  the  observed 
events  contained  in  the  complex  that  are  not  on  the  m-list  (i.e.,  that  are  singly  covered).  The 
obtained  refunions  are  called  “core"  complexes. 

(2)  A  best  ’host'  complex  is  determined  for  each  event  on  the  m-list 

An  event  is  selected  from  the  m-list  and  is  “added"  to  each  of  the  k  core  complexes  by 
generalizing  each  complex  to  the  extent  necessary  to  cover  the  event  Such  a  generalization  is 
performed  by  applying  the  REFUNION  operator  to  the  event  and  the  complex.  As  a  result,  k 
modified  complexes  are  obtained.  By  replacing  one  of  the  core  complexes  in  the  initial  set  with 
the  corresponding  modified  complex,  in  k  different  ways,  a  collection  of  clusterings  is  obtained. 
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These  clusterings  are  evaluated  according  to  the  given  clustering  quality  criterion  The  complex 
in  the  best  clustering  that  covers  the  given  event  from  the  m-list  is  considered  to  be  the  best 
"host"  for  this  event.  The  best  clustering  is  retained  and  the  remaining  ones  are  eliminated  By 
repeating  the  above  operation  for  every  event  on  the  m-list,  a  set  of  k  disjoint  complexes  is 
obtained  whose  union  covers  the  same  observed  events  as  the  original  set  of  nondisjoint 
complexes. 

If  an  event  cannot  be  “added"  to  any  complex  without  causing  the  result  to  intersect  other 
complexes,  then  the  event  is  placed  on  the  exceptions  list. 

5.3.  The  clustering  module 

The  fundamental  subalgorithms  described  above  are  used  as  component  parts  to  build  a 
composite  algorithm  (module)  for  generating  a  conjunctive  conceptual  clustering  that  splits  the 
collection  of  events  into  a  given  number  of  classes  The  general  algorithm  underlying  the 
implementation  of  the  clustering  module  was  introduced  by  Michalski  [l980b|  and  described  in 
Chapter  4.  Its  goal  can  be  described  as  follows' 

Given:  E,  A  collection  of  events  to  be  clustered 
k.  The  number  of  clusters  desired 
H,  The  goal  or  criterion  of  clustering  quality  LEF 
F\  An  optional  set  of  negative  events 

Find:  A  disjoint  clustering  of  the  collection  of  events  E  that  optimizes  the  givrn  criterion  of 

clustering  quality  H  and  covers  no  events  in  set  F'. 

A  straight  forward,  exhaustive-search  based  version  of  the  algorithm  is  described  first  and  then 
modifications  are  presented  to  increase  its  efficiency.  The  algorithm  is  summarized  by  the  flow 


Given:  E,  a  collection  of  events, 
k,  the  number  of  clusters, 

H,  the  evaluation  criterion  LEF 


Repeat  until  stopping  criterion  is  satisfied 

First  iteration?  _ _ _ _ 

_ — ' —  ’  no 

^^^^Clustering  quality  getting 

better'''''''^^ 

Choose  initial  seed 
events  from  E 

Choose  k  new  seeds 
which  are 
’central’  events 

Choose  k  new  seeds 
which  are 
’border’  events 

Create  a  star  for  each  seed  that  covers  it  against  the  other  seeds 

By  appropriately  modifying  and  selecting  complexes  from  stars, 
construct  a  disjoint  cover  of  E  that  optimizes  the  clustering 
evaluation  criterion  H 

Figure  5.2.  The  flow  chart  of  the  clustering  module. 


chart  in  Fig.  5.2.  The  steps  of  the  algorithm  are. 

(1)  Determine  initial  seeds  for  first  Iteration 

From  the  given  collection  of  events  E,  k  events  (the  initial  seeds)  are  selected.  The  seeds 


may  be  chosen  randomly  or  according  to  some  criterion.  (After  this  Drst  step,  seeds  are  always 


selected  according  to  certain  rules;  see  step  5). 

(2)  Construct  stars  for  seeds 

For  each  seed  e.,  a  reduced  star  RG(ej[F)  is  constructed  by  algorithm  REDUSTAR,  where  F 
is  the  set  of  remaining  seeds  union  F'  (F'  is  often  empty). 

(3)  Construct  a  disjoint  cover  by  selecting  and  modifying  complexes  from  stars 

Every  combination  of  complexes,  created  by  selecting  one  complex  from  each  star,  is  tested 
to  see  whether  it  contains  intersecting  complexes.  If  so,  the  complexes  are  modified  by 
procedure  NID  to  make  them  disjoint.  An  optimized  clustering  that  is  a  disjoint  cover  of  E  is 
produced. 

(4)  Evaluate  stopping  criterion 

If  this  is  the  first  iteration,  the  obtained  clustering  is  stored  In  subsequent  iterations  the 
clustering  is  stored  only  if  it  scores  better  than  previously  stored  clusterings  according  to  the 
LEF  The  algorithm  terminates  when  a  specified  number  of  iterations  does  not  produce  a  better 
clustering,  according  to  the  stopping  criterion  described  in  Sec.  4.3.3). 

(5)  Select  new  seeds 

New  seeds  are  selected  from  sets  of  observed  events  contained  in  complexes  of  the 
generated  clustering,  one  seed  per  complex.  Two  seed  selection  techniques  are  used.  One 
technique  selects  “central"  events,  defined  as  events  nearest  the  geometrical  centers  of  the 
complexes  (as  determined  by  the  syntactic  distance).  The  other  technique,  stemming  from  the 
“adversity  principle,"’  selects  “border"  events,  defined  as  events  farthest  from  the  centers.  Ties 
for  central  or  border  events  are  broken  in  favor  of  events  that  have  not  been  used  recently  as 
seeds.  The  technique  of  selecting  central  events  is  used  repetitively  in  consecutive  iterations  as 

4  This  principle  states  tbit  if  a  border  “near  hit*  »vent  truly  belongs  to  the  given  cluster,  then  when  selected  aj  ’he 
seed  it  should  produce  a  clustering  that  contains  the  same  events  as  when  a  central  event  is  used  as  a  seed 


long  as  the  clusterings  improve.  When  the  improvement  ceases,  border  events  are  selected. 
After  selecting  new  seeds,  the  algorithm  continues  from  step  2.  Along  with  a  clustering,  the 
algorithm  generates  k  class  descriptions  (complexes)  describing  individual  clusters,  and 
determines  how  well  these  complexes  score  on  the  evaluation  criteria  in  the  LEF. 

The  most  computationally  costly  part  of  this  algorithm  is  the  construction  of  an  optimized 
clustering,  given  k  seed  events  (step  3).  For  an  illustration,  let  us  assume  that  k='2  and  that  k 
"‘seeds’,  et  and  e„,  have  been  selected  from  the  collection  E.  In  the  first  step,  star  Gt  is 
Gfejremaining  seeds)  and  star  G„  is  G(e„|remaining  seeds).  Fig.  5.3  presents  complexes  of  these 
stars  as  branches  of  a  search  tree.  Branches  from  the  root  represent  complexes  of  star  G(  that 

are  au,  ar .  aim  -  3n<*  branches  at  the  second  level  (repeated  nij  times)  represent  complexes 

of  star  G„  that  are  a„r  .  “-la.  Each  combination  of  complexes,  containing  one  complex 

from  each  star,  corresponds  to  one  path  in  the  tree.  Because  any  such  combination  may  contain 
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intersecting  complexes,  procedure  NTD  is  applied  to  each,  and  the  resuit  is  a  disjoint  clustering 
These  clusterings  are  ordered  according  to  the  quality  criterion  LEF,  and  the  best  one  is 
selected, 

5.4.  Path-rank-ordered  search 

The  above  strategy  for  determining  a  clustering  from  seeds  is  very  simple,  but 
unfortunately  too  inefficient  for  solving  any  interesting  practical  problems.  This  is  due  to  the 
fact  that  the  stars  may  contain  very  many  complexes.  When  there  are  n  variables  and  k  seeds, 
a  star  may  contain  up  to  nk  l  complexes  (there  are  at  most  n  complexes  in  any  of  the  k-1 
elementary  stars  needed  to  compute  the  complete  star)  Thus,  when  n=30  and  k=3,  there 
could  be  up  to  nlc'1=900  complexes,  and  the  search  tree  could  have  up  to  900-way  branching  at 
each  node,  and  up  to  9003=729  million  leaves.  Absorption  laws  (as  defined  in  set  theory)  will 
usually  eliminate  many  redundant  complexes,  but  the  star  may  still  be  too  large.  Artificial 
intelligence  research  on  various  heuristic  search  procedures  offers  various  possibilities  for 
reducing  the  search  [e  g..  Nilsson,  1980;  Winston,  1977).  To  solve  this  problem,  some  of  the 
known  search  strategies  have  been  incorporated  with  some  newly  developed  ones.  The  result  is 
a  search  procedure  called  Path-Rank-Ordered  (PRO)  search  that  incorporates  the  following  four 
techniques: 

(1)  Bounding  the  stars  (procedure  BOUNDSTAR) 

The  number  of  complexes  in  a  star  is  bounded  by  a  fixed  integer  m,  which  assures  that  the 
search  tree  has  at  most  m-way  branching.  A  bounded  star  contains  not  just  m  arbitrary 
complexes  from  the  initial  star,  but  the  m  “best"  ones. 

At  each  step  of  star  generation  (a  multiplication  of  a  set  of  complexes  bv  the  next 
elementary  star,  see  STAR  algorithm  in  Sec.  3),  complexes  are  first  reduced  and  then  arranged 
in  descending  order  according  to  the  assumed  clustering  quality  criterion  LEF  Only  the  first  m 


complexes  are  retained  for  the  next  multiplication  step.  This  operation  is  also  performed  at  the 
end  of  star  generation,  so  that  the  final  star  has  at  most  m  complexes.  The  stars  so  obtained  are 
called  bounded  reduced  stars  and  denoted  G(e|F,m) 

Some  elementary  criteria  measure  global  properties  of  a  clustering  rather  than  properties 
of  just  a  single  complex  (e  g.,  the  inter-cluster  differences).  Consequently,  when  evaluating  a 
complex  descending  from  a  node  in  the  search  tree  that  is  not  the  root,  the  complex  is  evaluated 
in  the  context  of  complexes  associated  with  the  path  from  the  root  to  this  node. 

By  bounding  the  star,  the  process  gains  significantly  in  efficiency  but  gives  up  the 
assurance  that  the  obtained  clustering  will  be  optimal.  This  is  not  a  significant  loss,  however, 
because  the  clustering  obtained  at  the  end  of  each  iteration  contributes  only  the  seeds  to  the 
next  iteration,  and  thus  its  precise  expression  is  not  very  important. 

(2)  Generating  stars  dynamically 

Because  it  is  necessary  to  evaluate  complexes  in  the  context  of  previously  selected 
complexes,  bounding  a  star  has  to  be  done  differently  at  each  node  of  the  search  tree.  A  “lazy' 
star  generation  strategy  is  used,  in  which  a  star  is  generated  only  when  it  is  needed  to  expand  a 
node  on  the  path  being  explored. 

(3)  Searching  in  order  of  path  rank 

As  mentioned  above,  complexes  in  a  bounded  star  are  arranged  in  descending  order 
according  to  the  LEF.  In  the  search  tree,  the  branch  to  the  best  complex  is  assigned  the  branch 
index  0,  the  branch  to  the  next  best  complex  is  assigned  the  branch  index  1,  etc.,  up  to  the  index 
m-1.  The  path  index  of  a  path  from  the  root  to  3  leaf  is  the  sum  of  the  branch  indices  along  the 
path. 

The  paths  from  the  root  to  a  leaf  represent  potential  clusterings  and  are  investigated  in  the 
ascending  order  of  their  path  index.  Thus,  the  first  path  investigated  is  the  one  with  path  indp.x 


81 


£ 


i 


ft 


P 

■/ 


V, 


£ 


i 


i 

i 

i 

i 


v, 

y, 


I 

i 

I  *■  , 

i  ^ 


-V 

A 


0.  i.e. ,  the  path  containing  only  the  best  complexes  from  each  star  The  next  paths  considered 
are  those  with  a  path  index  of  one.  There  are  k  such  paths 

As  paths  of  increasing  path  index  are  generated  and  evaluated,  a  search  termination 
criterion  is  applied.  This  criterion  consists  of  two  parameters,  search-base  and  search-probe.  A 
search-base  number  of  paths  is  always  expanded  and  evaluated.  Then,  a  search-probe  number 
of  additional  paths  is  considered.  Each  path  is  processed  by  NID,  and  if  some  complexes  are 
transformed  to  make  them  disjoint,  the  clustering  quality  criterion  is  evaluated  again. 
Whenever  a  new  clustering  is  better  than  any  previous  clustering,  it  is  saved  and  another 
search-probe  number  of  additional  paths  is  explored  If  the  above  probing  fails  to  find  a  better 
clustering,  the  search  terminates. 

(4)  Tapering  the  search  tree 

The  bound  of  the  stars,  m,  is  decreased  with  the  increase  of  the  path  index.  The  search 
tree  is,  therefore,  more  fully  developed  on  the  side  containing  the  “higher  quality”  complexes. 

Fig.  5.4  shows  an  example  of  a  search  tree  generated  by  path  rank  ordered  search  The 
tree  is  a  modification  of  the  tree  in  Fig.  5.3,  resulting  from  the  application  of  the  above 
efficiency-increasing  techniques.  In  Fig.  5.4,  the  maximum  bound  is  set  to  3.  The  root  is 
expanded  by  constructing  the  star  Gfseedjother  seeds, 3),  whose  complexes  are  an,  and  a(J 
(listed  in  decreasing  order  of  their  “quality,”  as  determined  by  the  LEF).  The  branches 
representing  these  complexes  are  assigned  branch  indices  0,  1,  and  2,  respectively.  The  node 
attached  to  branch  0  is  expanded  next.  The  star  G(seed„|otber  seeds, 3)  is  generated,  creating 
complexes  a;[,  a^,  and  a^.  Branches  corresponding  to  these  complexes  are  assigned  branch 
indices  0,  1,  and  2,  respectively.  The  path  0-0  (having  the  lowest  path  index  of  0,  denoted  by 
heavy  lines  in  Fig.  5.4)  is  considered  first.  The  associated  clustering  {atn,  is  processed  by 
XID,  and  the  result  is  saved  as  the  best  clustering  so  far.  Next,  path  0-1  is  considered.  The 
associated  clustering  {au,  a„.,}  is  processed  by  NID  and  evaluated.  If  it  is  better  than  the 
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dtj  denotes  complex  j  from  star  i.  Integers  (^,CD . indicate  the  order 


of  expanding  nodes.  Integers  Q,  1 . indicate  the  branch  indices.  Integers 


2«  22 


. indicate  clustering  evaluation  scores  for  each  path. 

Figure  5.4.  The  path-rank-ordered  (PRO)  search  tree  for  k=2. 


previous  clustering,  it  is  saved.  In  order  to  explore  the  path  1-0  (the  second  path  with  path 
index  1),  the  star  G(seed2  |  other  seeds.2)  is  generated.  It  contains  complexes  a'^  and  a'„,. 
The  clustering  {ct12‘,  a',.}  associated  with  this  p3th  is  evaluated.  Assuming  that  the 
termination  criterion  has  the  parameters  searcb-base=2  and  search-probe=2,  and  that  the 
evaluation  scores  are  as  shown  in  Fig.  5.4,  the  tree  search  terminates  after  investigating  the 
fourth  path  0-2  (since  this  path  exhausts  the  probing  without  finding  a  better  clustering).  Path 
0-1,  with  the  evaluation  score  of  22,  is  the  best  clustering  found. 


5.5.  The  hierarchy  building  module 

The  hierarchy-building  module  uses  the  clustering  module  to  create  a  hierarchy  of  clusters. 
It  performs  two  loops,  one  iterative  and  one  recursive.  The  iterative  loop  repeats  the  clustering 
module  for  a  sequence  of  values  of  k  in  order  to  determine  the  value  for  which  the  most 
desirable  clustering  is  obtained.  Such  an  approach  is  computationally  acceptable  because,  in 
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practical  applications  most  interesting  hierarchies  will  have  a  relatively  small  number  of 
branches  (i.e.,  value  of  k)  at  each  level 

The  recursive  loop  applies  the  above  iterative  process  at  each  node  of  the  hierarchy  In  the 
first  step,  the  process  is  executed  for  the  root,  representing  the  initial  event  set  E.  Clusters  of  E 
and  their  conjunctive  descriptions  are  determined.  Consecutive  steps  repeat  the  same  operation 
for  the  nodes  representing  clusters  obtained  during  the  previous  step.  The  hierarchy  continues 
to  grow  from  the  top  down  until  the  continue-growth  condition  fails  to  be  met.  This  condition  is 
composed  of  three  parts:  the  height  of  the  hierarchy  must  be  below  the  height  limit 
MAXI {EIGHT,  the  number  of  events  in  a  cluster  must  be  above  a  minimum  number  MINSIZE, 
and  the  fit  between  the  clusters  and  their  descriptions  at  the  current  level  of  the  hierarchy  must 
be  better  than  at  the  previous  level. 

In  order  to  determine  the  optimal  value  of  k  at  each  node,  the  clustering  quality  criterion 
must  be  modified  so  that  it  can  compare  clusterings  with  different  numbers  of  complexes.  Such 
a  criterion  must  reflect  the  dependency  of  the  fit  between  the  clustering  and  data  on  the  value  of 
k  As  the  number  of  clusters  k  increases,  the  fit  (measured  by  the  negative  of  sparseness)  will 
likely  increase,  since  smaller  complexes  will  have  smaller  sparseness  On  the  other  band, 
increasing  k  increases  the  complexity  or  the  clustering  and  therefore  is  undesirable  A  simple 
criterion  that  takes  into  consideration  the  above  trade-off  is  to  require  the  product 

Total  sparseness  X  k® 

to  achieve  minimum  value,  where  3  is  m  experimentally  determined  parameter  balancing  the 
relative  effect  of  the  sparseness  and  the  number  of  clusters  k  on  the  solution. 

5.0.  Dynamic  modification  of  classifications 

The  classification  obtained  by  the  above  procedures  partitions  all  observed  events  into 
disjoint  conceptual  classes  Note  that  the  set-theoretic  union  of  all  classes  in  the  clustering  does 
not  necessarily  cover  the  whole  event  space,  i.e..  there  may  be  unobserved  events  which  are  not 
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covered  by  any  class  description. 


In  some  problem  situations  it  may  be  desired  to  revise  the  classification  incrementally  to 
cover  new  events  as  they  are  added  to  the  collection  of  observed  events.  This  can  be  done  using 
the  procedure  NID  as  follows.  The  complexes  of  the  current  clustering  play  the  role  of  “core" 
complexes,  and  the  new  event  is  treated  as  an  element  of  the  m-list.  The  event  is  incorporated 
into  the  complex  that  is  the  best  “host"  for  it,  as  determined  by  the  classification  goal  criterion. 
During  this  procedure,  an  original  complex  is  replaced  by  the  REFUNION  of  itself  and  the  new 


event.  NTD  performs  this  adjustment  on  each  class  description,  keeping  the  one  that  best  meets 
the  classification  goal,  and  returning  the  other  descriptions  to  their  original  state. 

Such  a  process  has  a  psychological  justification,  as  it  is  common  for  people  to  modify  their 
classifications  when  some  object  fails  to  fit  them,  by  appropriately  perturbing  the  boundaries  of 
the  classes 


5.7.  An  example  problem:  Rediscovering  soybean  diseases 

The  problem  is  to  reconstruct  a  classification  of  selected  soybean  diseases.  Given  are  47 
examples  of  soybean  diseases  each  characterized  by  the  35  multi-valued  variables  shown  in  Fig. 
5.5.  The  input  data  for  this  problem  is  given  in  Appendix  A  along  with  output  solutions  as 
generated  by  the  program.  These  examples  are  drawn  from  4  populations— each  population 
representing  one  of  the  following  soybean  diseases:  Diaporthe  stem  canker  ID1),  Charcoal  rot 
(D2).  Rhizoctonia  root  rot  (D3),  and  Phvtophthora  rot  (D4). 

Ideally,  a  clustering  method  should  partition  these  given  cases  into  four  groups 
corresponding  to  the  diseases.  To  test  this,  the  unstructured  classification  building  program 
(CLUSTER/2  (Stepp,  1984])  was  applied  to  this  problem.  To  contrast  the  conceptual  clustering 
results  with  those  of  traditional  numerical  taxonomy,  the  reader  is  asked  to  return  briefly  to  Fig 
2.1  which  shows  a  typical  dendrogram  produced  by  a  numerical  taxonomy  program  from  the 
5ame  soybean  data.  The  dendrogram  is  cut  at  the  wavy  line  to  create  four  classes  Classes  1. 
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Time  of  occurrence 

(’) 

Condition  of  stem 

(2) 

Plant  stand 

(2) 

Presence  of  lodging 

(2) 

Precipitation 

(3) 

Stem  cankers 

(4) 

Temperature 

(3) 

Canker  lesion  color 

(4) 

Occurrence  of  hail 

(3) 

Fruiting  bodies  on  stem 

(2) 

Number  of  years  crop  repeated 

H) 

External  decay  of  stem 

(3) 

Damaged  area 

(4) 

Mycelium  on  stem 

(2) 

Severity 

(3) 

Internal  discoloration 

(3) 

Seed  treatment 

(3) 

Sclerotia 

(2) 

Seed  germination 

(3) 

Condition  of  fruit  pods 

(4) 

Plant  height 

(2) 

Fruit  spots 

(5) 

Condition  of  leaves 

(2) 

Condition  of  seed 

(2) 

Leaf  spots — halos 

(3) 

Seed  mold  growth 

(2) 

Leaf  spots — margin 

(3) 

Seed  discoloration 

(2) 

Leaf  spot  size 

(3) 

Seed  size 

(2) 

Shotholing/shredding 

(2) 

Seed  shriveling 

(2) 

Leaf  malformation 

(2) 

Condition  of  roots 

(3) 

Leaf  mildew  growth 

(3) 

(Integers  in  parenthesis  indicate  the  number  of  values  in  the  domains.) 
Figure  5.5.  V'ariables  used  to  describe  diseased  soybeans. 


and  4  contain  events  from  the  same  disease  category  (coded  “Dl",  ‘D3”,  and  “D2", 
respectively).  Class  2,  however,  contains  cases  of  both  disexses  D3  and  Dl. 

The  program  CLUSTER/2  wxs  applied  to  the  problem  with  “maximizing  the  fit'  as  the 
evaluation  criterion  (LEF).  The  program  partitioned  the  disease  cases  into  four  disease 
categories  and  described  the  clusters  in  terms  of  the  characteristics  (patterns  of  symptoms)  of 
each  disease,  expressed  in  the  form  of  a  conjunctive  statement  The  produced  disease  categories 
corresponded  exactly  to  actual  soybean  diseases,  and  the  descriptions  produced  by  the  program 
corresponded  to  the  symptoms  indicated  by  plant  pathologists  for  these  diseases 

Figure  5.6  presents  the  complete  description  for  one  class  (one  disease  category).  The 
middle  column  contains  the  values  for  the  25  variables  the  program  used  to  describe  the  class. 
The  right-hand  column  of  Figure  5  6  presents  values  of  variables  used  by  an  expert  plant 
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Variable 

Value  range  determined 

Value  range  determined 

by  CLUSTER/2 

by  plant  pathologist 

Time  of  occurrence 

July  to  October 

August  to  September 

Precipitation 

above  normal 

normal  or  above  normal 

Temperature 

normal 

normal  or  above  normal 

No.  yrs.  crop  repeated 

more  than  one 

more  than  one 

Stem  cankers 

above  second  node 

above  second  node 

Canker  lesion  color 

brown  or  n.a. 

brown 

Fruiting  bodies 

present 

present 

Condition  of  fruit  pods 

normal 

normal 

Plant  stand 

normal 

Damaged  area 

scattered  areas  or  low  areas 

Severity 

potentially  severe  or  severe 

Seed  treatment 

none  or  fungicide 

Plant  height 

abnormal 

Condition  of  leaves 

abnormal 

Leaf  spots — halos 

absent 

Leaf  spots — margin 

irrelevant 

Shotholing/shreading 

absent 

Leaf  malformation 

absent 

Leaf  mildew  growth 

absent 

Condition  of  stem 

abnormal 

not  present  in 

External  decay  of  stem 

firm  and  dry 

expert  descriptions 

Mycelium  on  stem 

absent 

Int.  discolor,  of  stem 

none 

Sclerotia  int.  or  ext. 

absent 

Condition  of  fruit  pods 

normal 

Fruit  spots 

irrelevant 

Condition  of  seed 

normal 

Seed  mold  growth 

absent 

Seed  discoloration 

absent 

Seed  size 

normal 

Seed  shriveling 

absent 

Condition  of  roots 

normal 

Figure  5.6.  The  generated  description  of  one  class  (Diaporthe  Stem  Canker). 
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pathologist  to  describe  the  same  disease  for  diagnosis.  The  description  of  the  disease  determined 
by  the  program  contains  all  the  symptoms  of  the  disease  specified  by  the  plant  pathologist.  The 
values  of  “Time  of  occurrence,"  “Precipitation,"  and  “Canker  lesion  color"  determined  by  the 
program  are  supersets  of  the  values  mentioned  by  the  plant  pathologist.  The  slightly  expanded 
value  ranges  for  these  attributes  determined  by  the  program  are  correct  in  the  sense  that  disease 


Variable 

Claaa  Dl 
(Diaporthe  stem 
canker) 

Claaa  D2 

(Charcoal  rot) 

Claaa  D3 

(Rhiioctonia 

root  rot) 

Claaa  D4 

(Phytophtkora  rot) 

Plant  ttand 

normal 

normal 

irrelevant 

less  than  normal 

Precipitation 

above  normal 

below  normal 

above  normal 

normal  or  above 

Temperature 

normal 

normal  or  above 

below  normal 

normal  or  below 

Damaged  areal 

scattered  or 
low  areas 

whole  fields, 
upland  areas 

low  areas 

whole  fields, 
low  areas 

Stem  canken 

above  2nd 

node 

absent 

below  soil 

line 

below  or  slightly 
above  soil 

Canker  letion  color 

brown 

tan 

brown 

dark  br.  or  black 

Fruiting  bodiei  on  item 

present 

absent 

absent 

absent 

External  decay  of  item 

firm  and  dry 

absent 

firm  and  dry 

absent  or 

firm  and  dry 

Int.  diicolor.  of  item 

none 

black 

none 

none 

Sclerotta  int.  or  ext. 

absent 

present 

absent 

absent 

Condition  of  fruit  podi 

normal 

normal 

irrelevant 

irrelevant 

Condition  of  root I 

normal 

normal 

normal  or 

rotted 

rotted 

Figure  5.7.  A  summary  of  discriminant  variables  in 

the  generated  classification. 

cases  exhibiting  values  that  lie  outside  the  ranges  mentioned  by  the  pathologist  are  classified  by 
human  experts  as  cases  withing  the  disease  category  identified  by  the  program. 

The  generated  descriptions  also  involve  many  variables  which  the  plant  pathologist  did  not 
mention.  Fig.  5.7  shows  a  table  of  the  values  of  the  discriminant  variables  for  each  of  the  four 
classes  found  in  the  top  level  of  the  classification  hierarchy  generated  by  CLUSTER/2.  The 
entire  two-level  hierarchy  is  shown  in  Fig.  5.8  with  the  links  between  subclasses  labeled  with  the 
minimal  set  of  discriminant  variables  selected  from  the  complete  descriptions  of  each  subclass. 
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Figure  5.8.  A  two-level  classification  of  diseased  soybeans. 
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5.8.  Other  applications  of  attribute- based  clustering 

The  presented  method  of  attribute-based  conceptual  clustering  is  domain  independent  and 
this  has  encouraged  its  application  to  a  wide  variety  of  problems  In  one  experiment,  the 
method  was  used  to  build  a  classification  of  patients  with  various  craniosy nostosis  syndromes 
(eg,  Crouzon,  Saethre-Chotzen,  and  Apert  syndromes)  [Nlichalski,  Baskin,  Spackman,  1982|. 
The  data  consisted  of  18  binary  attributes  indicating  the  presence  or  absence  of  physiological 
features,  such  as  craniostenosis,  facial  asymmetry,  cleft  palate,  spinal  malformation,  etc.  Using 
the  goal  of  achieving  good  fit  of  the  classification  to  the  data,  two  classifications  of  14  patients 
were  made,  one  with  two  classes  and  the  other  with  three  classes.  The  three-class  solution 
produced  classes  (patient  groups)  and  descriptions  of  relevant  features  that  matched  three 
medically  established  syndrome  categories.  The  two-class  solution  consisted  of  one  group  of 
patients  having  one  syndrome  and  another  group  containing  a  mixture  of  patients  having  one  or 
the  other  of  two  syndromes 

The  presented  conceptual  clustering  method  has  also  been  used  to  build  classifications  of 
12  microcomputers  [Michalski  and  Stepp,  1983]  and  a  collection  of  100  Spanish  folksongs  [Stepp 


5.0.  Performance  analysis 

The  search  problems  inherent  in  this  method  of  conceptual  clustering  cannot  be  solved 
using  exhaustive  techniques  because  of  the  overwhelming  computational  complexity  The  use  of 
heuristic  search  permits  the  algorithm  to  produce  near-optimal  solutions  obtained  with  limited 
amounts  of  computation.  Unfortunately,  the  use  of  heuristic  search  makes  analysis  of  algorithm 
performance  exceedingly  difficult  since  the  amount  of  work  performed  varies  with  the  patterns 
in  the  data  as  they  influence  the  application  of  the  heuristics.  The  following  short  discussion 
analyzes  the  performance  of  the  CLUSTER/2  program  empirically 


CLL'STER/2  is  a  program  written  in  PASCAL  which  performs  conjunctive  conceptual 
clustering  on  unstructured  events  described  by  vectors  of  attribute  values,  as  described  in  this 
chapter.  For  the  analysis  of  performance,  the  problem  of  rediscovering  classes  of  soybean 
disease  is  used  to  exercise  the  program.  The  study  relates  the  overall  run-time  of  the  program 
to  the  three  following  program  variables: 

1.  the  problem  size  (number  of  events  and  number  of  attributes), 

2.  the  number  of  classes  formed, 

3.  the  stopping  criterion  composed  of  the  parameters  base  and  probe. 

The  effect  of  these  program  variables  on  performance  has  been  measured  empirically  by 
collecting  statistics  from  the  program  run  on  various  amounts  of  the  soybean  disease  data  with 
various  settings  for  control  parameters.  The  trends  reported  seem  to  be  reasonable  expectations 
of  the  performance  of  the  algorithm.  All  run  times  reported  are  based  on  runs  obtained  on  a 
CDC  Cyber  175  running  the  NOS  operating  system. 

In  the  problem  of  building  a  two-class  classification  of  diseased  soybeans,  the  PRO  search 
parameters  such  as  search-probe  and  the  maximum  number  of  branches  at  each  interior  node  in 
the  search  tree  (see  Sec.  5.1)  had  a  minor  effect  on  the  performance.  The  overall  effect  of  these 
parameters  (both  individually  and  collectively)  on  the  run  time  was  sublinear  for  search-probe 
varying  from  2  to  8  and  the  maximum  number  of  branches  at  each  node  varying  from  1  to  4. 
Although  this  empirical  result  applies  only  to  the  soybean  data  with  k=2.  the  findings  are 
reasonable  *ince  these  search  parameters  increase  the  number  of  hypothetical  clusterings 
considered  approximately  linearly,  but  some  of  the  complexes  and  clusterings  considered  are 
duplicates  that  are  discarded 

5.0.1.  Problem  size  versus  run  time 

To  evaluate  the  effect  of  problem  size  on  the  performance,  the  soybean  disease  problem 
was  run  with  21  and  12  selected  events  from  the  original  47  events.  The  selected  events  were 


taken  equally  from  the  four  classes  of  diseases  which  humans  identify  in  the  data  in  an  attempt 


to  maintain  the  same  underlying  conceptual  interpretation  of  the  data,  Other  control 
parameters  were  kept  constant  across  all  runs.  Fig.  5.9  shows  the  run  times  for  various  numbers 
of  events  for  the  first  level  clustering  problem  in  which  clusterings  for  k  =  2,  k=3,  and  k  =  4  are 
constructed.  The  influence  of  the  number  of  events  on  the  run  time  is  judged  to  be  linear. 
Since  the  process  time  per  generated  complex  increases  linearly  with  the  number  of  attributes, 
the  influence  of  number  of  attributes  on  the  total  run  time  is  also  linear  Thus,  the  overall  run 
time  of  the  algorithm  is  roughly  proportional  to  the  product  of  the  number  of  events  times  the 
number  of  attributes  used  to  describe  each  event. 


Number  of  events:  47  21  12 

Run  time  (sec):  92.8  46  1  27.0 

Figure  5  9  Run  times  for  various  numbers  of  events. 


5.9.2.  Number  of  classes  versus  run  time 

The  run  time  is  also  affected  bv  the  range  of  number  of  classes  constructed.  Here,  an 
analysis  is  presented  of  the  time  required  to  complete  one  clustering  for  a  given  number  of 
clusters  k.  In  the  direct  method  used  in  CLUSTER/2,  all  k  clusters  are  created  and  then 
'‘juggled"  (by  NID.  see  Sec  5.2.5)  to  make  them  disjoint.  The  amount  of  computation  needed  to 
do  this  must  rise  as  the  number  of  clusters  rises  Fig.  5  10  shows  some  computation  times  for 
producing  clusters  with  various  numbers  of  classes.  Because  heuristics  are  involved,  the  number 
of  iterations  of  various  parts  of  the  algorithm  vary  in  an  unpredictable  fashion  with  the  number 
of  classes  formed  Judging  from  Fig.  5  10,  the  effect  of  number  of  clashes  on  run  time  appears  to 
be  of  higher  than  linear  order  (perhaps  quadratic).  A  quadratic  efTect  would  be  reasonable  since 
the  number  of  stars  built  is  generally  proportional  to  the  number  of  classes,  and  the 
computation  time  per  star  is  roughly  proportional  to  the  number  of  logical  multiplication  steps 


performed  which  goes  up  in  approximate  proportion  to  the  number  of  classes.5 

5.9.3.  Stopping  criterion  versus  run  time 

The  stopping  criterion  has  a  major  influence  on  the  performance  of  the  algorithm,  but  it  is 
hard  to  interpret  its  effects.  The  stopping  criterion  is  specified  in  terms  of  the  parameters  base 
and  probe.  Base  determines  both  the  number  of  initial  iterations  and  the  number  of  alternative 
results  reported.  It  has  little  effect  on  run  time.  Probe  determines  how  many  iterations  are 
performed  looking  for  a  new  locally  optimum  clustering.  If  a  true  optimum  clustering  is 
achieved,  then  the  probe  number  of  iterations  performed  beyond  it  are  wasted — they  just  add  to 
the  computational  expense.  If  a  higher  probe  value  causes  the  probe  iterations  to  reach  a  new 
local  optimum,  then  the  computation  cost  is  somewhat  offset  by  the  achievement  of  an  improved 
result  The  soybean  disease  problem  was  run  for  various  values  of  the  probe  parameter  for  the 
two  class  solution.  In  this  problem,  the  best  solution  is  obtained  in  iteration  3,  even  when  the 
algorithm  is  made  to  perform  a  total  of  II  iterations  (as  it  did  with  probe  set  to  8).  Thus  for 
this  problem,  a  higher  value  of  probe  yielded  no  improvement  in  result  and  a  linearly  rising 
computational  cost.  This  behavior  is  not  at  all  predictable.  Fig.  5.11  presents  the  run  times 
obtained  for  the  soybean  disease  problem  with  various  values  for  probe.  When  taking  this  data, 
the  number  of  classes  was  two. 


Number  of  classes: 

•1 

3 

4 

Time  for  12  events: 

3  3 

5.7 

15.9 

Time  for  24  events: 

6  1 

10  0 

30  0 

Time  for  47  events: 

13.1 

34  7 

45  0 

Figure  5.10.  Run  times  in  seconds  for  various  numbers  of  classes  and  events. 


Probe  value:  12  4  8 

Run  time  (secs):  9.5  12.3  18.1  28.9 

Figure  5.11.  Run  times  for  different  probe  values. 


5.10.  The  effect  of  parameter  fS  on  optimal  class  number 

The  measure  of  the  total  sparseness  of  the  solution  is  used  to  judge  the  best  number  of 
classes  to  form  at  each  level  of  the  hierarchy.  Data  from  the  clustering  of  soybean  disease  cases 
(with  base=l  and  probe=l)  for  k  =  2  through  k=6  are  summarized  in  Fig.  5.12.  As  k  increases, 
the  sparseness  usually  decreases  because  events  are  partitioned  into  smaller  complexes  that  can 
fit  the  data  better.  On  the  other  hand,  increasing  k  is  undesirable  as  it  raises  the  complexity  of 
the  clustering.  The  measure  used  that  reflects  this  trade-off  is 

S  =  sparseness  X  k® 

where  3  is  a  parameter  that  balances  the  influence  of  k  versus  the  sparseness.  Fig  5.12  shows 
values  of  parameter  S  for  3=0  through  3=1  and  k=2  to  k=6  for  the  clusterings  of  soybean 
diseases.  For  low  values  of  3.  the  best  clustering  indicated  by  the  smallest  value  of  S  is  with 
k=5.  As  the  importance  of  number  of  classes  is  increased  by  increasing  the  value  of  3.  the  best 
clustering  shifts  to  k  =  4  at  3=3-  By  extrapolating  the  values  in  Fig.  5 .12,  the  best  number  of 
classes  to  form  shifts  to  2  when  3  is  set  to  7.  The  value  of  3=3  is  the  default  setting  that 
appears  to  give  good  balance  to  the  number  of  classes  versus  the  fit. 


Figure  5  12.  Values  of  sparseness,  S,  and  cpu  time  for  different  values  of  k. 
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CHAPTER  8 

■  METHOD  2:  CLUSTERING  STRUCTURED  OBJECTS 
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0.1.  Overview 

This  chapter  preseats  the  methodology  for  building  classifications  of  examples  which  are 
described  by  conjunctive  statements  in  first-order  logic.  The  specific  representational  scheme  is 
an  extended  predicate  calculus  called  Variable-valued  Logic  system  2  (VL„)  [Michalski,  1980a] 
which  is  a  subset  of  the  more  recent  language,  Annotated  Predicate  Calculus  [Michalski,  1983], 
described  in  Chapter  4.  The  VL„  representation  has  much  more  expressive  power  than  the 
attribute  representation  used  in  the  previous  chapter. 

When  considering  problems  involving  structured  examples,  one  usually  thinks  of  Winston's 
blocks-world,  and  his  pioneering  work  on  learning  discriminant  descriptions  of  structures  (e.g., 
arches)  [Winston,  1975],  Consider  the  nine  blocks-world  examples  and  selected  corresponding 

descriptions  shown  in  Fig.  6.1.  Object  parts  are  represented  by  existentially  quantified 
variables.  (If  the  explicit  quantification  is  omitted,  it  is  always  implied.)  It  will  be  shown  later 
that  it  is  the  existential  quantification  that  makes  the  conceptual  clustering  problem  difficult 
when  handling  structured  objects. 

The  mechanisms  for  performing  inductive  inference  on  VI,  „  statements  are  graph-theoretic. 
It  is  therefore  important  to  review  the  graph  representation  semantics  that  underly  the  VL„ 
statements. 


3  pl,p2,p3,  [ontop(pl,p2)j  (ontop(p2,p3)|  [size(pl)=medium|  [size(p2)=medium] 
[size(p3)=large]  [texture(pl)=clear]  [texture(p2)=shaded]  [texturc(p3)=clcar] 
[shape(pl)=>=diamond]  |shape(p2)=circle]  (sbape(p3)=usbape]  [inside(p2,p3)|. 


3  pl,p2,p3,  jontop(pl,p2}]  [ontop(pl,p3)|  [next(p2.p3)|  [size(pl)=large| 
[size(p2)=emedium|  (size(p3)=*mediumj  [texture(pl)=*clear]  [tcxture(p2)=shaded| 
(texture(p3)=*shaded|  (shape(pl)=eHipse|  [sbape(p2)=circlej  [shape(p3)=circle]. 


3  pl,p2,  [ontop(pl.p2)|  [texturc(pl)=shaded]  [texture(p2)=sbaded| 
[shape(pl)»trianglcj  jshapc(p2)=ellipse|  [sizc(pl)=mediuml  jsize(p2)=mediumj. 


Figure  6.1.  Nine  structured  objects  and  selected  corresponding  descriptions. 


8.2.  Representing  VL„  statements 


6.2.1.  Lexical  representation 

The  VLj  language  that  is  implemented  in  the  program  INDUCE/31  is  defined  by  the  5- 
tuple  (V,F.S,R,I)  where: 

V  is  a  set  of  variable  symbols.  Each  variable  symbol  x(  is  associated  with  a  domain  D(x.j.  A 
group  of  variables  which  have  the  same  domain  are  labeled  with  the  same  variable  symbol 

with  different  subscripts,  e  g  y1,y„.  .yk,  Zj.z., . z,  are  specifications  of  variables  in  two 

variable  groups  that  assume  values  from  two  domains  denoted  D(y)*»D(y.)  and  D(z)“D(z.). 

F  is  a  set  of  n-ary  function  and  predicate  symbols  Each  n-ary  function  symbol  represents  a 
mapping  from  an  argument  space  into  the  domain  of  the  function.  For  a  function 
f(xrx„ . xn),  this  is  a  mapping 

D(x,)  X  D(xJ  X  ...  x  D(xn)  -  D(D 

where  D ( x t ) .  D(xJ . D(xJ,  D(f)  represent  the  domains  of  the  variables  x[t  x„,  ...  xn  and 

the  domain  of  the  function  f,  respectively.  A  predicate  is  a  function  whose  domain  is  the 
set  of  values  {FALSE, TRUE}  or  equivalently  {0, 1 }. 

S  is  a  set  of  symbols  including: 

()[]  =  <>stas=^AV3,. 

R  is  a  set  of  formation  rules  as  follows.  Formulas  are  used  to  describe  situations,  and  also  as 
parts  of  implicative  statements.  The  formulas  are  defined  by  the  following  rules: 

1.  A  selector  is  a  formula. 

2.  If  V,  V  and  V„  are  formulas,  then  so  are: 

1  INDUCE.  S  u  an  extended  version  of  INDUCE/l  (Larson  and  Michalslo.  1977,  Larson,  1977'  and  INDUCE  '2  'Hoff, 
Michalski.  and  Stepp,  1383]. 
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(V) 

-V 

v,  A  v„  or  VjV, 
VlVV2 

3  (V) 


a  formula  in  parentheses 

inverse 

conjunction 

disjunction 

existential  quantification 


The  form  of  a  selector  is  either 

[atomic-function  REL  value-of-atomic-function\ 


or 


[ predicate-functionj . 

The  form  [ atomic-function  REL  value-of-atomic-function j  (e.g.,  [color(box)=redVblue])  is 
defined  in  Chapter  4.  The  form  [predicate-function]  (e.g.,  [ontop(box  ,box2)|)  is  equivalent 
to  [predicate-function=  1]  (i.e.,  [predicate-funclion=TRUE]).  Below  are  some  examples  of 
selectors: 


Selector 

3  walllt  (colorfwallj)  =  white] 
3  boxr  [lengthfboxj  >  l] 

3  boXj,  (weight(boxl)  =  2. .5] 

3  x,,  x2,  [ontop(x1,x2)| 


Interpretation:  (TRUE  if) 

The  color  of  the  wall  “wal^”  is  white. 

The  length  of  the  box  “box^  is  greater  than  1. 

The  weight  of  box  “box^  has  a  value  between  2  and 
5,  inclusively. 

The  part  “x”  is  on  top  of  the  part  “x,". 


I  is  a  set  of  interpretation  rules  that  follow  the  well  established  logical  interpretations  given 
to  negation,  conjunction,  disjunction,  and  existential  quantification  [Hoff,  Michalski  and 
Stepp,  1983] . 
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6.2  J.  Graph  representation 

A  VL„  formula  can  be  represented  as  a  colored2  graph  with  labeled  nodes  and  directed 
labeled  edges.  The  labels  on  the  nodes  can  be  either  a  selector  containing  an  Q-ary  descriptor 
without  its  argument  list,  or  a  quantified  variable.  The  edges  are  optionally  labeled  with 
integers  1.2....  that  refer  to  the  position  of  the  argument  at  the  head  of  the  edge.  The  label  is 
omitted  if  the  argument  position  is  irrelevant. 


For  simplicity,  the  graph  structure  for  conjunction  and  disjunction  of  selectors  is  omitted 
from  the  graphs.  Each  graph  is  interpreted  as  the  conjunction  of  all  selector  nodes  in  the  graph. 
A  disjunctive  description  having  one  or  more  disjunctions  of  conjunctions  of  selectors  is 
represented  as  the  disjunction  of  two  or  more  graphs.  Thus,  a  graph  structure  contains  just 
selector  nodes  and  existentially  quantified  variable  nodes.  It  is  adequate  for  representing  one 
VT,  complex  (a  conjunctive  description).  As  an  example,  the  statement  describing  event  e?  from 
Fig.  6  1  is  shown  in  Fig.  6.2  as  a  graph  The  logical  evaluation  of  the  graph  is  the  conjunction  of 


all  selectors  shown  in  the  the  middle. 


E 

f<r, 

pr, 

[v, 

.  V  * 
*  \ 

I 

f: 

If  V  and  V„  are  VT„  statements,  implicative  and  equivalence  statements  may  be  formed  as 

V1  =>  V2  and  Vf  <■■— >  V„. 

Vj  is  called  the  condition  and  V„  is  called  the  consequence.  Each  is  represented  by  a  separate 
graph  or  a  disjunction  of  graphs.  At  present,  the  consequence  must  be  a  single  conjunctive 
statement.  In  an  implicative  statement,  if  Vt  is  true  then  V„  is  asserted:  if  VJ  is  not  true  then 
nothing  is  known  about  V„.  In  an  equivalence  statement,  if  V  is  true  then  V„  is  asserted:  if  V 
is  not  true  then  the  negative  of  V„  is  asserted.  To  make  the  negative  assertion  unambiguous,  \\ 
is  restricted  to  be  just  a  single  selector  in  equivalence  statements.  The  negative  of  such  a  single 
selector  [x.  =  value-list],  where  x.  is  a  function  symbol  and  value-list  is  the  internal  disjunction 
of  possible  values  the  function  can  take,  is  the  selector  [x.  =  D(x.)  -  {rafue-/«et}].  That  is,  the 

2  A  colored  graph  bis  nodes  md  links  thit  match  only  if  they  hive  corresponding  link- -olor  ind  node-color  libels 
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U  [texture  =  shaded] 


jtexture  =  shaded] 


[shape  =  triangle] 


[shape  =  ellipse] 


[size  =  mcdium| 


[size  =  medium|  n 


[SANIE-texture  =  1| 


[SAME-size  = 


Graph  of  e.:  3  pr  p2,  [oniop(p1,p;.)j[texture(p1)=shadcdj[texture(p„)=shadcd| 
[shape(pl)=triangle][shape(p„)=p|lipse][size(p1)=medium] 
(size(p„)=medium][SAME-texture(p1p„)|[SAME-size(p).p„)| 

Figure  6.2.  The  graph  representation  of  example  e?. 


selector  is  negated  by  asserting  that  variable  x.  takes  a  value  in  the  complement  of  the  value-set 
with  respect  to  the  domain  of  x.. 


6.3.  Comparing  two  complexes  by  graph  matching 

In  the  process  of  evaluating  generalized  class  descriptions  it  is  necessary  to  logically 
compare  two  complexes.  Given  two  complexes  a[  and  a„,  the  possible  questions  to  ask  are 
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,  i. 


•  do  a  and  a„  intersect’ 

(i.e..  does  there  exist  any  example  which  could  satisfy  both  at  and  a„’), 

•  does  a1  completely  cover  a„? 

(i.e.,  do  all  examples  that  satisfy  a,,  also  satisfy  o^?). 

Note  that  examples  are  represented  in  the  same  language  and  graph  structure  as  complexes. 
Thus,  with  a„  replaced  with  a  description  of  an  example,  the  second  test  can  determine  if  a 


particular  generalized  description  cij  covers  a  particular  example  e.  Tests  to  answer  both  of  the 
above  questions  3re  minor  variations  on  a  colored  graph  matching  algorithm,  outlined  below. 

Given  are  two  graphs  Qj  and  Q„,  each  in  the  form  illustrated  in  Fig.  6.2.  On  successful 
match,  every  node  of  Qt  will  be  uniquely  assigned  to  a  matching  node  of  0„.  A  node  of  Qf 
matches  a  node  of  Q„  if  it  has  the  same  color  and  is  linked  via  links  of  the  same  color  to  other 
matching  nodes.  The  color  of  a  node  is  the  combination  of  the  type  (selector  or  quantified 
variable),  the  function  name,  and  the  list  of  function  values.  The  color  of  a  link  is  the  link 
ordinal  that  specifies  argument  order.  If  no  ordinal  is  present,  the  link  has  the  color  0. 

Each  conjunctive  VL„  complex  may  contain  selectors  involving  zero-place  functions  (i.e., 
simple  attributes)  plus  one  or  more  groups  of  connected  selectors  involving  single-  or  multi-place 
functions.  Connected  selectors  are  those  whose  graph  is  completely  connected,  i.e.,  an  efficient 
traversal  exists  of  the  entire  graph  from  any  starting  node.  The  process  of  matching  one 
complex  with  another  involves  matching  the  zero-place  selectors  and  then  making  a  traversal  of 
each  connected  graph  while  accumulating  pairs  of  matching  nodes. 

The  way  a  selector  is  matched  depends  on  the  question  being  asked.  If  the  question  is  that 
of  intersection,  a  pair  of  selectors  are  matching  if  they  have  the  same  function  symbol  and  at 
least  one  common  value  in  their  value  lists.  If  the  question  is  that  of  determining  if 
completely  covers  a„,  a  selector  S;  in  a[  matches  selector  S„  in  a„  only  if  and  S„  contain  the 
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same  function  symbol  and  all  values  in  the  value  list  of  S„  are  also  present  in  the  value  list  of  S( 

After  finding  matching  pairs  for  all  zero-place  selectors  (i.e. ,  those  involving  zero-place 
functions),  a  count  of  ‘  vectors  in  Q„  is  made  by  function  symbol.  If  Qj  contains  more  instances 
of  a  particular  function  symbol  than  does  Q„,  the  graph  match  is  impossible. 

Next,  the  node  with  the  most  colored  links  is  found  and  becomes  the  root  node  of  a 
spanning  tree  of  Qr  If  all  links  are  uncolored  (i.e.,  colored  0),  the  spanning  tree  is  headed  by  the 
node  with  the  greatest  number  of  links.  If  the  spanning  tree  fails  to  encompass  all  nodes  (in  the 
case  of  graphs  that  are  not  completely  connected)  the  process  is  repeated  for  the  remaining 
nodes.  Each  secondary  spanning  tree  is  attached  to  the  end  of  the  primary  tree  so  that  one  tree 
traversal  will  visit  all  nodes  (other  than  the  zero-place  selectors)  in  the  complex. 

The  graph  Q(  is  traversed  according  to  the  spanning  tree.  For  each  node  of  Q(  a  matching 
node  of  Q„  is  sought.  A  node  in  Q„  matches  one  in  Qt  if  the  Q„  node  is  not  matched  with  any 
other  node,  it  has  the  same  function  symbol  or  quantified  variable  symbol,  all  links  connect  to 
nodes  that  have  been  matched,  and  (for  selector  nodes)  the  value  list  is  correct  depending  on  the 
test  for  intersection  or  for  complete  coverage  as  described  earlier.  The  nodes  of  Q„  are  accessed 
in  internal  data  structure  sequence  (i.e.,  not  by  graph  link)  in  search  of  the  first  candidate  node. 
Afterwards,  nodes  in  Q„  are  accessed  by  links  corresponding  to  matching  Qj  links.  When  a 
matching  node  in  Q,  cannot  be  found,  backtracking  3long  the  spanning  tree  is  performed  until 
either  failure  occurs  (all  possible  subgraphs  of  Q„  have  been  considered)  or  a  previous  state 
involving  uncolored  links  is  uncovered  and  the  tree  traversal  proceeds  again  with  a  different 
match  of  links. 

On  successful  graph  match,  a  list  of  matching  node  pairs  is  available.  This  list  includes  all 
nodes  in  Qj  and  a  subset  of  those  in  Q„.  The  internal  state  of  the  traversal  of  the  spanning  tree 
over  Qj  is  checkpointed  so  that  the  search  can  be  resumed  if  it  is  desired  to  search  further  for 
additional  isomorphisms  between  Qj  and  Q„.  Thus,  this  algorithm  can  produce  either  a  boolean 


match  or  no  match  output,  or  complete  node  pairings  for  one  or  more  matches  of  Q(  onto 
subgraphs  of  Q„.  By  preplanning  the  graph  search  starting  with  a  node  with  the  most  colored 
links,  the  amount  of  backtracking  is  minimized. 

8.4.  Structure  template  matching 

The  graph  match  algorithm  of  the  previous  section  is  often  used  to  map  one  structure 
template  (given  by  a  covering  complex  T)  onto  each  isomorphism  found  in  a  set  of  complexes  E. 
The  graph  match  identifies  corresponding  quantified  variables  in  the  template  and  in  the 
example.  It  is  then  possible  to  recode  all  examples  in  an  attribute/value  form  without  quantified 
variables. 

This  process  begins  by  assigning  unique  dummy  attributes  xp  x„,...  to  each  zero-place 
function  and  each  single-  or  multi-place  function  in  T  Then  T  is  matched  with  an  example  e  in 
E  If  there  is  no  match,  no  recoding  of  e  is  performed — e  is  skipped  If  there  is  a  match  of 
graphs,  then  e  is  recoded  in  terms  of  the  dummy  attributes  to  form  an  unstructured  complex  of 
the  form 

K  =  aiII*2  =  A-l  •••  =  AJ 

where  a  value  list  A.  is  the  same  as  the  value  list  in  e  for  the  selector  which  is  graph  matched 
onto  one  in  T  assigned  to  dummy  variable  x.. 

If  additional  isomorphisms  between  T  and  e  are  found,  each  one  yields  an  independent 
attribute-based  unstructured  complex.  When  this  is  completed  for  all  examples  in  E,  a  complete 
attribute-only  description  of  E  under  the  constraint  of  structure  template  T  has  been  generated. 
This  process  is  handy  for  generating  attribute  descriptions  of  examples  for  use  in  generalizing 
only  the  value  list  portions  of  graphs  without  changing  the  graph  structure.  After  such  a 
generalization,  the  generalized  value  lists  can  be  used  to  replace  the  value  lists  in  corresponding 


selectors  in  T. 
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As  an  example,  let  T  be  the  structure  template 

jontop(pl,p2)j[size(pl  )=mediumVlarge][texture(p2)=shadedj 
and  let  E  be  composed  of  the  three  examples  e^  e  and  e.  from  Fig.  6.1.  The  following  four 
unstructured  complexes  are  produced  by  structure  template  matching  with  attributes  Xj 
assigned  to  ontop,  x„  assigned  to  size,  and  x3  assigned  to  texture. 

1:  [x,  =  l]|x„  =  medium][x3  =  shaded] 

2:  [x,  =  l|[x,  =  largejj.Xj  =  shaded] 

3:  ]x(  =  l][Xj  =  large][x3  =  shaded) 

4:  (Xj  =  l] [x0  =  medium]jx3  =  shaded] 

Complex  1  above  is  derived  from  example  e^  Complexes  2  and  3  are  derived  from  example  e4 
where  the  template  matches  in  two  different  ways.  Complex  4  is  derived  from  example  e_. 

6.5.  Repeated  discrimination 

The  algorithm  developed  for  unstructured  events  in  Chapter  5  is  modified  for  application 
to  structured  events.  The  fundamental  approach  is  the  same:  classifications  are  constructed  for 
k  varying  from  kmir|  through  k^  by  iteratively  selecting  k  seed  events  and  then  using  inductive 
inference  (learning  from  examples)  to  generate  descriptions  for  k  classes.  As  necessary,  multiply- 
covered  events  are  reassigned  to  a  class  by  the  procedure  NID  (suitably  modified  for  structured 
events).  When  this  approach  is  followed,  the  resulting  class  descriptions  may  be  weakly 
intersecting,  i.e.,  the  description  spaces  intersect  but  not  at  the  points  representing  observed 
events.  For  some  uses,  this  intersection  is  undesirable.  The  approach  presented  in  Chapter  7 
uses  a  method  that  always  generates  disjoint  class  descriptions. 

The  algorithm  using  repeated  discrimination  to  generate  classifications  for  structured 
examples  is  presented  here  in  a  fashion  that  parallels  the  description  of  the  approach  for 
unstructured  examples  in  the  previous  chapter.  The  following  subsections  describe  the 
similarities  and  differences  between  the  methods  as  they  relate  to  criterion  evaluation,  generating 
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conceptuji  covers,  applicable  generalization  transformations,  building  a  star,  and  making 
intersec  ,  g  classes  disjoint  (or  at  least  only  weakly  intersecting). 

A. 5.1.  Criterion  evaluation 

As  with  the  method  used  for  building  classifications  of  unstructured  events  in  Chapter  o. 
the  classification  goal  is  specified  by  combining  elementary  evaluation  criteria  in  a  user-specified 
LEF.  As  described  in  Chapter  5.  the  LEF  gives  an  ordered  list  of  elementary  criterion  functions 
which  are  to  be  used  and  the  tolerance  associated  with  each  function  The  elementary  criteria 
implemented  in  the  program  INDUCE/3  are: 

(1)  The  number  of  positive  examples  that  are  covered  by  a  class  description. 

(2)  The  number  of  selectors  in  a  class  description. 

(3)  The  number  of  negative  examples  that  are  covered  bv  a  class  description 

(4)  The  total  cost  of  all  functions  contained  in  a  class  description 

(3)  The  total  cost  of  all  quantified  variables  used  in  a  class  description 

A. 5. 2.  Generating  conceptual  covers 

For  unstructured  examples,  covers  of  selected  examples  are  generated  by  the  REFUNION 
operation  (Sec.  5  2.2)  Given  a  set  of  examples  represented  as  complexes,  the  REFUNION  of  the 
complexes  is  the  most  specific  generalization  that  covers  all  examples.  It  is  easy  to  compute 
REFUNION  for  unstructured  examples  when  all  examples  are  described  by  identical  attribute 
lists.  Finding  the  REFUNION  for  a  set  of  structured  objects  is  much  more  difficult,  since  an 
object  may  contain  unique  subparts  that  have  no  corresponding  part  in  any  other  object,  or  it 
may  have  several  subparts  th3t  are  similar  in  multiple  ways  to  some  part  of  another  object. 

In  terms  of  the  graph-theoretic  representation  of  VL„  complexes,  the  REFUNION  of  a  set 
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of  such  complexes  is  the  maximal3  graph  which  is  isomorphic  to  some  subgraph  of  each  complex 
Finding  such  a  graph  is  computationally  expensive.  A  method  for  generating  a  quasi-optimal 
(quasi-maximal)  REFUNION  of  a  set  of  complexes  C  is  summarized  in  the  diagram  of  Fig  6.3. 
The  process  begins  by  developing  a  number  of  quasi-maximal  graphs  by  adding  selectors  one  at 


Given:  C,  the  collection  of  complexes  to  be  covered, 
the  evaluation  criterion  LEF 


Pick  a  seed  event  c  t  C 


Generate  set  Rc  composed  of  single-selector  complexes  as  the 
first  partial  REFUNION 


Empty  set  R 


Repeat  until  R  contains  NCONSIST  complexes 


Generalize  all  value  lists  to 


Trim  complexes  in  Rc  to  \T.\LAXST.\R 


Make  .ALTER  many  new  offspring  complexes  out  of  each 
parent  complex  in  Rc  by  adding  one  new  selector 


Discard  complexes  which  become  too  specific;  save  in  set 
R  any  parent  complex  whose  offspring  are  all  too  specific 


Make  a  maximally  specific  generalization  of  the  value  lists  in 
complexes  in  R 


Use  LEF  to  select  the  best  REFUNION  complex 


Figure  6.3.  An  algorithm  for  generating  a  REFUNION  of  structured  examples. 


3  A  maximal  graph  is  one  with  the  greatest  number  of  nodes. 
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a  time  until  subsequent  additions  would  overly  specialize  the  graph  such  that  it  would  not  cover 
all  complexes  in  C.  Then  the  reference  lists  of  the  selectors  in  the  graph  and  those  in  zero-place 
selectors  are  generalized  bv  applying  the  various  value  set  transformations  of  Chapter  4  The 
generalizations  are  performed  to  a  degree  that  balances  the  desire  for  simple  value  lists  with  that 


for  forming  a  maximally  specific  description  (e  g.,  a  list  of  values  in  a  linear  domain  would  be 
generalized  to  the  single  minimal  enclosing  interval) 

Given  to  the  REFUNION  procedure  are  a  set  of  complexes  to  be  covered  C  and  an 


evaluation  criterion  LEF.  One  complex  e  in  C  is  arbitrarily  selected  as  the  seed.  The  first  set  of 
candidate  REFUNION  complexes  are  generated  to  form  the  set  Rc  Each  complex  consists  of  a 
single  selector  extracted  from  the  graph  for  e.  Next,  an  iterative  process  is  performed  to  grow 
the  candidate  complexes,  one  selector  at  a  time,  until  any  further  growth  makes  them  too 
specific. 

Each  iteration  involves  four  steps.  First,  all  candidate  complexes  in  Rc  are  made  more 
general  by  replacing  all  value  lists  in  selectors  with  the  “don't  care”  symbol  *  which  denotes  the 
whole  domain  of  the  function.  Second,  the  complexes  are  trimmed4  and  duplicates  eliminated 
such  that  only  the  VLMAXSTAR  (user-defined  parameter)  number  of  complexes  remain  in  Rc 
Then  third,  each  surviving  parent  complex  is  used  to  generate  ALTER  (user-defined  parameter) 
number  of  offspring  complexes.  Each  offspring  contains  one  more  selector  than  the  parent  The 


offspring  are  given  different  selectors  from  e  that  are  not  not  in  the  parent  complex  Selector*.  i,. 

add  from  e  are  chosen  according  to  their  connectedness *  to  the  parent  The  offspring  ••m; . 

replace  the  parent  in  set  Rc.  The  fourth  and  final  step  of  each  iteration  •  ••■ 


L>  > 


created  offspring  complexes,  eliminating  all  that  fail  to  cover  all  . -omj 
offspring  of  one  parent  are  so  eliminated  the  pareni  complex  -  ; 


i  ii 


i  Trimming  i?  done  to  limit  thf  "ombmii  rui  •>  •  ?.  i* 

w :oQ?tder*i 
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result  set  R.  When  all  offspring  are  too  specific,  the  parent  is  maximally  specific. 

When  the  above  iterations  are  completed,  set  R  contains  a  number  of  quasi-maximally 
specific  complexes,  all  of  which  cover  all  complexes  in  C.  The  size  of  set  R  is  given  by  the 
parameter  NCONSIST.  Note  that  the  value  lists  in  the  selectors  are  still  the  “don’t  care"  value 
*  at  this  point. 

The  value  lists  are  replaced  by  new  values  that  are  generalized  only  to  the  extent  necessary 
to  cover  all  complexes  in  C.  The  following  processing  is  applied  to  every  complex  r  in  set  R. 
The  structure  template  match  algorithm  of  Sec.  6.3.  is  used  to  generate  attribute-based 
descriptions  of  all  complexes  in  C.  Set  B  will  denote  the  resulting  attribute-based  complexes 
corresponding  to  complexes  in  set  C.  Starting  with  a  working  complex  in  which  the  value  lists  of 
all  selectors  are  empty,  each  complex  b  in  B  that  was  derived  from  the  same  concept  in  C  is 
merged  with  the  working  complex  by  forming  the  union  of  values  in  value  sets  of  selectors  in  the 
working  complex  and  those  in  b.  Value  set  transformations  are  applied  to  the  merged  complex 
using  the  GEXRLIZ  procedure  as  described  in  Sec.  5.2.3.  The  change  in  amount  of 
generalization  caused  by  each  merge  operation  is  measured  and  the  complex  which  gives  rise  to 
the  minimum  amount  of  generalization  is  selected.  The  other  complexes  considered  are 
discarded.  Each  complex  in  C  which  is  covered  by  the  working  complex  is  marked  and  each 
complex  in  B  which  was  derived  from  a  marked  complex  in  C  is  also  removed.  The  process 
repeats  with  the  working  complex  set  at  the  state  following  the  value  list  merge  for  the  selected 
complex  from  B.  When  all  complexes  in  B  are  eliminated,  the  working  complex  contains  value 
lists  that  are  generalized  the  minimum  amount  to  cover  all  examples  in  C.  These  value  lists  are 
returned  to  graph  r  that  was  previously  used  as  the  template  complex.  The  evaluation  LEF  is 
used  to  pick  the  best  complex  from  set  R  after  each  has  undergone  the  value  list  processing  just 


described. 


6.5.3.  Generalization  transformations 

All  generalization  transformations  described  in  Sec.  4.2  are  implemented  in  the  program 
INDUCE/3  whose  inference  procedures  are  used  to  carry  out  the  conceptual  clustering 
algorithms  involving  structured  objects.  The  descriptor  construction  transformations  are 
provided  as  a  prelude  to  inductive  inference  so  that  the  constructed  descriptors  augment  the 
complexes  describing  examples.  The  process  is  divided  into  three  passes  over  the  complexes. 

The  first  pass  applies  the  transformations  for  generating  chain  properties  rule  and 
generating  equivalence  relations  rule.  For  example,  when  this  pass  is  completed  for  the  first 
example  in  Fig.  6.1,  the  following  selectors  are  added  to  the  graph  representation  of  the 
complex  describing  e  : 

[MOST-ontop(pl)|[LEAST-ontop(p3)I(MOST-inside(p2)I[LEAST-inside(p3)|  A 
(SAME-size(pl.p2)][SAME-texture(pl.p3)] 

The  second  pass  applies  background  knowledge  inference  rules  to  the  examples.  The  graph 
matching  procedure  is  used  to  compare  the  left  hand  side  of  each  background  knowledge  rule  to 
the  description  of  each  example.  When  a  match  is  found,  the  selectors  in  the  right  hand  side  of 
the  background  knowledge  rule  are  appended  to  the  example  description  (unless  they  are 
already  present)  using  the  same  binding  of  quantified  variables  establish  by  the  graph  match. 
The  background  knowledge  rules  are  recursively  applied  until  no  further  matches  to  examples 
are  found. 

The  third  pass  over  the  example  descriptions  is  to  add  zero-place  descriptors  for  counting 
quantified  variables,  counting  similar  selectors,  counting  distinct  references,  and  adding 
universal  properties.  For  example,  when  this  is  done  for  example  e7  from  Fig.  6.1,  the 
constructed  zero-place  selectors  are 

[#parts=2|[#parts(texture=shaded)=ij(forall-parts(texture=shaded)j[#diff-textures=l|  A 
[#parts(shape=triangle)=l][#parts(shape=p||ipse)=l][#diff-shapes=2]  A 


[#parts(size=medium)=2j[forall-parts(size=medium)|[#diff-sizes=2| 

Note  that  the  “forall"  predicates,  which  may  be  added  by  application  of  the  universal  properties 
descriptor  construction  transformation,  provide  a  way  to  capture  limited  universal  quantification 
semantics  while  still  keeping  the  simple  graph  representation  that  has  only  selector  and 
existentially  quantified  variable  nodes. 

The  several  dimension-reducing  and  relevant  value  set  transformations  are  applied  during 
star  generation.  They  are  described  below. 

6.5.4.  Building  a  star 

The  process  of  generating  a  star  from  structured  events  is  somewhat  different  than  the 
process  described  in  Chapter  5.  A  star,  denoted  by  G(e|F),  is  a  set  of  consistent  class 
descriptions  each  of  which  covers  event  e  and  none  of  the  events  in  event  set  F.  The  procedure 
begins  by  forming  a  partial  star  Gp(e)  which  is  a  set  of  class  descriptions  each  consisting  of  one 
unique  selector  from  the  description  of  event  e.  Each  description  in  Gp  covers  event  e  and 
possibly  one  or  more  events  in  set  F,  i.e.,  some  descriptions  in  Gp  may  not  be  consistent  with 
respect  to  F. 

At  this  point  each  description  in  Gp  consists  of  just  a  single  selector.  The  process  described 
in  the  next  paragraph  is  performed  iteratively  to  specialize  the  descriptions  by  conjoining  one 
additional  selector  on  each  iteration.  Any  generated  descriptions  which  are  consistent  (i.e.,  do 
not  cover  any  events  in  F)  are  placed  on  a  list  of  alternative  descriptions.  The  process  continues 
until  a  preset  number  of  consistent  alternatives  have  been  generated,  or  until  all  possible 
selectors  from  event  e  have  been  conjoined.  The  final  value  of  G(e|F)  is  the  set  of  complexes  in 
the  resulting  list  of  alternatives. 

On  each  iteration  each  description  a  in  Gp(e|F)  is  compared  with  the  description  of  event 
e.  A  list  of  predicates  and  functions  that  are  in  e  but  not  in  a  is  generated.  A  limited  number 


of  these  predicates  and/or  functions  is  selected  and  their  corresponding  selectors  are  conjoined 
separately  to  complex  a  to  produce  different  specializations  of  description  a.  The  number  of 
predicates  and/or  functions  selected  (and  hence  the  number  of  alternative  specializations)  is 
given  by  the  parameter  ALTER.  The  order  of  selection  of  predicates  and/or  functions  is  by 
decreasing  connectedness  to  predicates  and/or  functions  already  in  a.  The  connectedness  of  two 
predicates  or  functions  is  the  number  of  arguments  they  have  in  common. 

After  generating  new  descriptions,  the  partial  star  contains  ALTER  times  more  candidate 
descriptions  than  before.  To  limit  the  combinatorial  explosion,  each  new  partial  star  is  trimmed 
down  to  just  a  few  of  the  best  descriptions,  as  determined  by  the  evaluation  criterion  given  by 
the  LEF.  The  number  of  descriptions  retained  in  each  partial  star  is  given  by  the  parameter 
VLMAXSTAR. 

When  a  set  of  consistent  descriptions  has  been  built,  they  have  the  property  that  they 
cover  event  e  (possibly  other  events  in  set  E  as  well)  and  none  of  the  events  in  F.  Furthermore, 
the  last  operation  to  a  class  description  (i.e.,  conjoining  an  additional  selector)  transforms  the 
description  from  one  that  was  too  general  (and  inconsistent)  to  one  that  is  possibly  too  specific 
(although  consistent).  The  need  thus  arises  to  perform  some  limited  generalization  to  make  the 
description  as  general  as  possible,  but  still  not  cover  any  event  if  F.  The  generalization 
considered  is  that  of  generalizing  the  value  list  portion  of  one  or  more  selectors.  This  is  done 
using  the  (unstructured)  techniques  of  Chapter  5.  specifically  the  star  generation  algorithm  for 
unstructured  examples.  It  is  in  this  stage  too  that  the  value  list  transformations  of  dropping 
condition,  adding  alternatives,  closing  the  interval,  and  climbing  the  value  hierarchy  are 
preformed  where  appropriate.  Given  a  complex  a  to  generalize,  value  list  generalization 
proceeds  in  the  following  way. 

(1)  A  modified  complex  a’  is  created  from  complex  a  by  replacing  all  value  lists  in  selectors 

with  the  don't  care  symbol  (this  symbol  denotes  all  possible  values  in  the  domaio  of 
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(2)  All  subgraphs  of  all  examples  that  match  the  graph  of  a'  are  found.  Each  isomorphism 
yields  a  derived  positive  event.  This  is  done  by  assigning  a  dummy  attribute  to  each 
selector  in  complex  a'  and  then  generating  attribute/value  pairs  for  each  selector  in  the 
example  subgraph,  as  described  in  Sec.  6.3.  For  each  attribute/ value  pair,  the  attribute  is 
the  one  assigned  to  the  corresponding  selector  of  a'  and  the  value  is  the  value  list  from  the 
selector  in  the  example  subgraph. 

(3)  Using  the  star  generation  technique  of  Chapter  5,  the  most  general  (unstructured) 
description  is  found  that  covers  an  event  derived  from  event  e  and  optionally  other  derived 
positive  events,  but  no  events  derived  from  negative  events  in  F. 

Corresponding  selectors  that  fit  a  structural  template  are  used  to  derive  a  set  of  positive  and 
negative  events  that  are  unstructured.  A  star  is  built  using  derived  events,  G(e'|F')  where  e'  is 
an  unstructured  event  derived  from  e,  and  F'  is  the  set  of  all  events  derived  from  events  in  F. 
This  star  contains  alternative  ways  to  maximally  generalize  the  reference  values  without 
covering  any  event  in  F*.  These  reference  values  are  returned  to  the  corresponding  selectors  in 
the  original  (structured  VL„)  complex.  Since  no  event  in  F*  is  covered,  if  follows  that  no  event 
in  F  is  covered.  Since  at  least  one  isomorphism  e'  of  e  is  covered,  e  is  covered  too.  After  this 
step,  the  value  lists  are  as  general  as  possible,  and  thus  G(e|F)  has  the  most  general  property 
which  is  sought. 

8.5.5.  NID:  Making  nondlajoint  complexes  disjoint  or  weakly  Intersecting 

The  star  building  algorithm  generates  complexes  containing  functions  and  predicates  of 
existentially  quantified  variables.  Each  complex  is  a  conjunction  of  selectors.  Such  a  complex 
contains  neither  negation  nor  disjunction,  although  a  selector  may  contain  internal  disjunction 
and  internal  negation,  as  described  in  Chapter  4.  One  result  of  this  constraint  is  that  there  is  no 
construct  to  indicate  the  negative  quantification  “ there  does  not  exist."  Complexes  constrained 
to  use  existential  quantification  without  negation  will  logically  intersect  unless  made  disjoint  by 


non-intersecting  value  lists  of  zero-place  descriptors.  This  is  illustrated  by  considering  the  two 
complexes 

(1)  3  part,  [size(part)=large| 
and 

(2)  3  part,  (size(part)ssmallj 

While  these  statements  appear  to  split  the  universe  into  large  and  small  things,  they  actually 
intersect.  This  intersection  includes  an  object  containing  two  parts  such  as 

3  part^  part,,,  [size(partl)*small|[size(part0)=*=large)|. 

One  way  to  make  the  class  descriptions  (1)  and  (2)  become  disjoint  is  to  introduce  a  zero-place 
selector,  such  as  [#parts=»l|.  The  two  descriptions 

(3)  3  part,  [#parts=  lj[size(part)=small| 

(4)  3  part.  [#parts=lj(size(part)»largej 

are  now  disjoint — no  example  exists  which  satisfies  both  descriptions.  This  illustrates  the 
importance  of  zero-place  (quantifier-free)  descriptors.  Such  descriptors  are  created  by 
application  of  the  descriptor  construction  transformations  described  in  Chapter  4. 

It  may  happen  that  no  disjoint  zero-place  descriptors  are  used  to  describe  the  classes  at 
hand.  In  such  a  case  it  is  not  possible  to  generate  disjoint  descriptions  thought  it  may  be 
possible  to  make  them  become  only  weakly  intersecting.  Two  descriptions  are  weakly 
intersecting  if  they  intersect  only  at  unobserved  events,  i.e.,  if  no  given  example  satisfies  both 
descriptions.  In  the  remainder  of  this  section,  a  method  will  be  described  for  transforming 
intersecting  descriptions  into  ones  that  are  disjoint  or  intersect  only  weakly. 

Given  are  k  complexes  ar  a2,...,  ak,  a  set  of  events  E,  and  seed  events  e1,...,ek  for  each 
complex.  If  no  event  in  E  is  covered  by  more  than  one  complex,  then  the  set  of  complexes  is 
disjoint  or  only  weakly  intersecting  and  the  algorithm  exits  without  having  to  do  any  work. 


All  observed  events  which  are  multiply  covered  are  put  into  set  M.  Then  k  event  sets  Aj, 
IsSisk,  are  built  with  A(  containing  all  events  covered  by  a,  but  not  in  M.  Each  complex  a,  is 
replaced  by  the  structured  REFUN'ION  complex  obtained  by  covering  the  example  set  A.. 
Because  tne  REFUN’ION  complexes  are  maximally  specific,  they  do  not  intersect  on  observed 
events  and  are  either  disjoint  or  weakly  intersecting. 

At  this  point,  the  events  in  M  are  not  covered  by  any  complex.  Each  event  in  M  is 
assigned  to  one  of  the  k  complexes  by  completing  the  following  steps. 

(1)  K  augmented  complexes  a’,,  isisk,  are  constructed  by  building  the  structured 
REFUNION  complex  covering  A,  and  event  mcM  being  fitted  to  a  complex. 

(2)  Event  m  is  assigned  to  the  complex  o'j,  lSjSk,  which  covers  m  and  is  best  according  the 
the  LEF.  Aj  is  replaced  by  Aj  U  {m}  and  a  'j  replaces  a,. 

In  the  end,  the  a'  complexes  are  output  along  with  a  report  of  any  events  which  could  not  be 
covered. 


0.0.  An  example  problem:  Classifying  bloeks-world  figures 

The  presented  methodology  will  be  illustrated  by  an  example  using  the  blocks-world  figures 
in  Fig.  6.1.  Annotated  input  and  output  statements  for  the  program  INDUCE/3  that  hosts  a 
prototype  implementation  of  the  method  are  given  in  Appendix  B. 

The  input  for  the  problem  consists  of  nine  VL,  example  descriptions  (of  the  kind  shown  in 
Fig  6.2)  and  some  background  knowledge  consisting  of  the  types  of  the  variables  plus 
statements  defining  a  value  hierarchy  for  the  function  shape  as  illustrated  in  Fig.  6.1. 

The  initially  given  function  and  predicate  symbols  used  to  describe  the  examples  and  their 


value  domains  are: 


Symbol 

Domain 

Description 

ontop(x.y) 

{0,1} 

x  is  ontop  of  y 

inside(x.y) 

{0,1} 

x  is  inside  of  y 

next(x.y) 

{0,1} 

x  and  y  are  next  to  each  other 

texture(x) 

{clear  .shaded} 

the  texture  of  x 

siie(x) 

{small, medium, large} 

the  size  of  x 

shape(x) 

{triangle, square, rectangle, 

diamond, circle, ellipse, u>sbape, 

polygon, curved} 

the  shape  of  x 

The  following  derived  descriptors  are  added  by  the  application  of  descriptor  construction 
transformations. 

Symbol  Domain  Description 

MOST-ontop(x)  {0,1}  x  is  a  top  part 

LEAST-ontop(x)  {0,1}  x  is  a  bottom  part 

MOST-inside(x)  {0,1}  x  is  an  inner  part 

LEAST-inside(x)  {0,  l} 


x  tn  an  outer  part 


SAME-texture(x,y,...) 

{0,1} 

the  parts  have  the  same  texture 

SAME-size(x,y,...) 

{0,1} 

the  parts  have  the  same  size 

SAME-shape(x,y,...) 

{0,1} 

the  parts  have  the  same  shape 

#parts 

{0-4} 

the  number  of  parts 

#parts(property) 

{0..4} 

the  number  of  parts  with  given  property 

#diff-textures 

{0-2} 

the  number  of  different  textures 

#diff-sizes 

{0-3} 

the  number  of  different  sizes 

#diff-shapes 

{0-4} 

the  number  of  different  shapes 

forall-parts(property) 

{0,1} 

property  holds  for  all  parts 

In  this  example,  no  background  inference  rules  are  used. 

The  classifications  obtained  for  k=2,  k=3,  and  k=4  are  shown  in  Figs.  6.5,  6.6,  and  6.7, 
respectively.  For  this  problem  involving  only  nine  examples,  the  classification  is  not  hierarchical. 
The  goal  of  the  classification  was  to  maximize  the  specificity  of  descriptions  as  indicated  by  the 
number  of  selectors  they  contain.  For  the  sake  of  clarity,  the  descriptions  shown  in  Figs.  6.5 
through  6.7  are  edited  to  contain  only  those  selector  parts  which  take  different  values  in  at  least 
two  of  the  complexes.  The  conceptual  clustering  algorithm  generates  descriptive  statements 
rather  than  discriminant  rules.  For  the  clusters  in  Fig.  6.5,  the  full  descriptive  statement 
includes  about  40  selectors.  Except  for  the  selector  ‘#parts(texture=clear)”,  the  values  sets  of 
corresponding  selectors  in  the  descriptive  statements  intersect.  The  complete  descriptive 
statements  for  all  clusters  are  given  in  Appendix  B. 

In  Fig.  6.5,  the  classifications  are  based  on  the  number  of  parts  of  a  certain  texture.  In  the 
first  classification,  one  class  contains  figures  having  less  than  2  clear  parts  and  the  other  class 
contains  figures  with  2  to  3  clear  parts.  In  the  second  classification,  one  class  contains  figures 
having  exactly  one  shaded  part  and  the  other  class  contains  figures  having  two  or  three  shaded 
parts.  In  each  case,  the  ranges  of  numbers  of  parts  were  determined  by  developing  a 


conjunctive  concept  describing  each  class  which  was  optimized  with  respect  to  the  goal  of  the 
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Class  1:  3  partr  part*,  [#parts=2..3]  [#parts(size=medium)#3] 

[#parts(size=large)*3]  [#parts(texture=clear)<2|  [MOST- 
ontoplpart^j  [ontopfpartj.part,,)]  (shape(partj)*circle) 
(shape(part„)=curvedj  [texture(part2)=shaded| 

"there  is  a  top  part  which  is  not  a  circle  ontop  of  a  curved  part 
and  there  are  2  or  3  parts  of  which  fewer  than  2  are  clear  and  the 
medium  size  parts  and  large  parts  number  other  than  3" 

Class  2:  3  partj,  part2,  [#parts=3]  [#parts(size=medium)=l] 

(#parts(size=large)=2|  [#parts(texture=clear)=l|  [MOST- 
ontop(partt)|  [ontop(part1,part2)j  [shape(part1)=circle| 
[shape(part„)=triangle]  [texture(part2)=clear] 

"there  is  a  top  part  which  is  a  circle  ontop  of  a  triangle  and  there 
are  3  parts  of  which  1  is  medium  size,  2  are  large,  and  1  is  clear" 

Class  3:  3  partj,  part2,  [#parts=3..4j  |#parts(size=medium)— 2] 

(#parts(size=large)<2|  [#parts(texture=clear)=2..3|  (MOST- 
ontopfpartj)]  jontopjpartj.part,,)]  [shapefpartj^rectangle] 

(sh  ape(  p  ar  t£)  #  squ  are] 

"there  is  a  top  part  which  is  a  non-rectangle  ontop  of  a  non-square 
part  and  there  are  3  to  4  parts  of  which  2  are  medium  size,  less 
than  2  are  large,  and  2  to  3  are  clear" 


Class  1:  #dillerent-shapes=2]  [#parts(shape=ushape)=0] 
#parts(size=medium)=2]  [#parts(size=large)<2] 

”2  different  shapes  are  present  and  there  are  no  ushape  parts,  2 
medium  size  parts,  and  fewer  than  2  large  parts' 


Class  2:  [#different-sbapes=2..3]  [#parts(shape=ushape)<2] 
[#parts(size=medium)=1..2]  [#parts(size=large)<2| 

"2  to  3  different  shapes  are  present  and  there  are  fewer  than  2 
ushape  parts,  1  to  2  medium  size  parts,  and  fewer  than  2  large 
A3Z3  parts" 


Class  3:  [#different-shapes=3|  [#parts(shape=ushape)=l] 
[#parts(size=medium)<2]  [#parts(size=large)=s2] 

A  ”3  different  shapes  are  present  and  there  is  one  ushape  part,  fewer 
il  than  2  medium  size  parts,  and  2  targe  parts' 


(The  LEF  is  to  maximize  the  no.  of  events  in  a  class  and  the  no.  of  selectors  in  a  class 
description.  The  two  classifications  are  from  the  first  two  iterations  of  the  algorithm.) 

Figure  6  6.  Two  alternative  classifications  of  blocks-world  figures  for  k=3. 


classification  as  given  by  the  LEF.  The  descriptions  in  Fig.  6.5  are  disjoint  because  they  are 
based  on  non-intersecting  value  lists  of  zero-place  functions. 

In  Fig.  6.6,  the  selectors  from  the  complete  class  descriptions  which  take  different  values  in 
each  class  are  shown  along  with  the  selectors  for  MOST-ontop,  ontop,  and  #parts  that  serve  to 
bind  the  variable  part,  to  a  particular  part  of  the  blocks-world  figure.  The  first  classification  is 
based  on  the  descriptors  shapejpartj,  shape(part„),  te.xture(part„),  #parts(size=medium), 
#parts(size=large),  and  #parts(texture=clear).  The  conjunction  of  selectors  using  these 
descriptors  is  sufficient  to  form  three  disjoint  classes.  Classes  1  and  2  are  mutually  disjoint 
because  of  the  #parts(size=medium)  and  #parts(size=Iarge)  selectors.  Classes  1  and  3  are 
mutually  disjoint  because  of  the  #parts(texture=clear)  selector.  Classes  2  3nd  3  are  mutually 
disjoint  in  a  way  the  program  cannot  detect.  The  class  descriptions  differ  on  the  values  of 
selectors  involving  shapejpartj,  shape(part„),  and  texture(part„).  Given  the  constraints  of 
MOST-ontop,  ontop,  and  #parts,  it  is  logically  impossible  to  build  any  blocks-world  figure  that 
satisfies  both  class  descriptions.  The  proof  of  this  conjecture  is  the  only  means  to  determine 
that  the  class  descriptions  are  disjoint.  The  program  currently  is  not  capable  of  doing  this.  It 
can  only  compare  zero-place  function  values  to  determine  if  descriptions  are  disjoint  in  that 
manner.  The  second  classification  in  Fig.  6.6  is  based  on  the  descriptors  #different-shapes, 
#parts(shape=ushape),  #parts(size=medium),  and  #parts(size=large).  Complete  descriptive 
statements  for  all  classes  shown  in  Fig.  6.6  are  given  in  Appendix  B. 

Fig.  6.7  shows  a  classification  with  k=4.  There  are  17  descriptors  that  take  different 
values  in  two  or  more  classes.  For  ease  of  presentation,  three  descriptors  that  can  collectively 
discriminate  between  all  four  clusters  have  been  selected  and  used  in  the  descriptions  shown  in 
Fig.  6.7.  The  full  characteristic  descriptions  of  the  clusters  are  given  in  Appendix  B.  The 
generated  class  descriptions  are  mutually  disjoint,  based  on  the  value  lists  for  selectors 


containing  zero-place  functions. 


Class  1:  (forall-parts(shape=curved)=FALSE|  [#parts(size=medium)=0] 
[#parts(texture=clear)=0] 

"objects  have  no  medium  size  or  clear  parts  and  not  all  parts  are 
curved  shape" 


Class 


2:  (forall-parts(shape=curved)=FALSE)  [#parts(size=medium)=1..2] 
[#parts(texture=clear)=0..1| 

"objects  have  0  or  1  clear  parts,  1  to  2  medium  size  parts,  and  not  all 
parts  are  curved  shape" 


Class  3:  (foral!-parts(shape=curved)|  [#parts(size=medium)=2] 
[#parts(texture=clear)=l] 

"objects  have  I  clear  part  and  2  medium  size  parts  and  all  parts  are 
curved  shape" 


Class  -4:  [forall-parts(shape=curved)=FALSE]  [#parts(size=medium)=2] 
(#parts(texture=clear)— 2..3] 

"objects  have  2  to  3  clear  parts,  2  medium  size  parts,  and  not  all 
parts  are  curved  shape" 


(The  LEF  is  to  maximize  the  no.  of  events  in  a  class  and  the  no.  of  selectors  in  a 
class  description.  The  classification  from  the  first  iteration  of  the  algorithm.) 

Figure  6.7.  A  classification  of  blocks-world  figures  for  k=4. 


6.7.  Performance  analysis 

The  method  presented  in  this  chapter  for  clustering  structured  events  requires  more 
computation  power  than  the  method  presented  in  Chapter  5  for  clustering  unstructured  events. 
As  an  example  of  this  difference,  consider  the  primitive  function  for  determining  if  a  complex  a 
covers  an  event  e.  When  dealing  with  unstructured  complexes  and  events,  the  attribute  vector 


used  in  all  complexes  and  events  is  the  same.8  This  makes  it  easy  to  compare  selector  value  lists 

6  When  i  complex  u  printed,  selectors  with  value  lists  containing  ill  values  in  their  respective  domains  ire  not 
printed.  In  the  implementation,  the  internal  representation  of  a  complex  has  a  slot  for  a  selector  involving  each  attn- 


to  see  if  all  values  for  an  event  are  also  present  in  the  complex.  If  so,  the  complex  covers  the 
event.  When  dealing  with  structured  complexes  and  events,  each  event  and  each  complex  may 
be  composed  of  a  different  combination  of  descriptors.  To  compare  a  complex  and  an  event  it  is 
necessary  to  match  the  graph  of  the  complex  to  the  graph  of  the  event.  This  requires  much 
more  computation  than  merely  comparing  attribute  vectors.  The  net  result  of  the  added 
computational  cost  of  the  method  for  handling  structured  events  is  that  more  emphasis  is  placed 
on  heuristics.  This  makes  performance  trend  analysis  more  difficult. 

The  implementation  in  the  PASCAL  program  INDUCE/3  has  two  layers.  The  first  layer 

deals  with  the  graph-encoded  “rules"  (complexes  and  events)  while  the  second  layer  deals  with 

the  attribute-encoded  selector  value  list  parts  of  rules.  For  historical  reasons  the  first  layer  has 

been  called  “VL"  and  the  second  layer  has  been  called  “AQ".  Heuristic-based  star  generation 

takes  place  in  both  layers.  In  the  VL  layer,  the  parameter  VLMAXSTAR  specifies  the  number 

of  complexes  to  retain  from  one  step  of  star  generation  to  the  next.  The  parameter  ALTER 

specifies  the  number  of  different  selectors  to  consider  for  appending  (one  at  a  time)  to  each  of 

the  VLMAXSTAR  complexes  to  specialize  it.  When  NCONSIST  number  of  complexes  have  been 

specialized  such  that  they  cover  no  events  in  the  “against"  class  F,  the  selector  value  lists  in 

each  complex  are  generalized  by  the  AQ  layer.  By  the  process  of  template  matching  (see  Sec. 

6.4),  the  AQ  layer  receives  an  attribute-list  image  of  the  value  list  parts  from  selectors  of  events 

corresponding  to  selectors  in  the  complex  being  considered  in  the  VL  layer.  The  AQ  layer 

performs  attribute-based  star  generation  using  the  heuristic  parameter  AQMAXSTAR  to  limit 

the  number  of  (attribute)  complexes  that  are  retained  during  its  star  generation  process. 

Although  there  are  four  controlling  parameters,  the  parameters  controlling  breadth  of  search 

(VLMAXSTAR,  AQMAXSTAR,  and  ALTER)  will  be  given  the  same  value  and  their  influences 

evaluated  together.  The  influence  of  NCONSIST  on  the  performance  was  evaluated  separately 

and  found  to  be  relatively  unimportant  in  its  effect  on  run  time.  For  the  blocks-world  figures 

bate  The  vilae  list  is  encoded  is  i  seqaence  of  biniry  bits  with  one  bit  corresponding  to  eich  vilne  in  the  domiin  If 
ill  bits  ire  I  s  (i  e  ,  if  ill  vilues  in  the  domnn  ire  in  the  vilue  list)  the  selector  is  not  printed 


problem,  the  values  of  2,  4,  and  8  for  NCONSIST  made  a  change  in  run  time  of  only  1%  and 
made  no  change  in  the  generated  clusterings.  This  may  not  be  true  for  other  clustering 
problems. 

The  following  discussion  considers  the  effects  on  run  time  of  the  algorithm  by 

1.  the  problem  size  (number  of  events  and  number  of  descriptors  used), 

2.  the  number  of  classes  formed,  and 

3.  the  breadth  of  search  during  star  generation. 

0.7.1.  Problem  size  versus  run  time 

To  evaluate  the  empirical  relationship  between  problem  size  and  run  time,  the  blocks-world 
clustering  problem  wxs  solved  with  all  9  events,  with  3  eliminated,  and  with  6  new  events  added. 
The  run  times  are  shown  in  Fig.  6.8  for  two-class  solutions  made  with  ALTER,  VLMAXSTAR, 
AQMAXSTAR,  and  NCONSIST  set  to  4.  From  the  times  reported  in  Fig.  6.8,  there  is  an 
approximately  linear  effect  between  9  and  18  events  with  the  time  for  6  events  being  surprisingly 
higher  than  the  time  for  9  events.  A  partial  explanation  is  that  the  heuristics  caused  the  work 
performed  by  NID  (which  accounts  for  much  of  the  run  time)  to  consist  of  8,  6,  and  10  star 
generation  steps,  respectively  for  the  different  problem  sizes.  When  the  cost  per  star  generation 
is  estimated  by  dividing  the  run  time  by  the  number  of  such  steps  performed,  the  estimated  star 
generation  times  are  5.57,  5.91,  and  8.93  seconds,  respectively.  Thus,  the  cost  of  star  generation 
(the  most  significant  computational  expense)  rises  approximately  linearly  with  number  of  events. 


Number  of  events: 

6 

9 

18 

Run  time  (secs): 

44.5 

35.1 

89.3 

Number  of  stars  built  by  NID: 

8 

6 

10 

Time  per  star  (secs): 

5.57 

5.85 

8  93 

Figure  6.8.  Run  times  for  different  numbers  of  events. 
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0.7.2.  Number  of  classes  versus  run  time 

Noting  the  evidence  presented  in  Chapter  5  for  a  quadratic  effect  by  the  number  of  classes 
on  the  run  time  for  the  problem  of  clustering  unstructured  soybean  disease  events,  a  similar 
behavior  for  clustering  structured  events  would  be  expected.  The  data  in  Fig.  6.9  presents  the 
run  times  for  generating  two-class,  three-class,  and  four-class  classifications  of  the  nine  blocks- 
world  figures.  For  these  runs,  the  parameters  ALTER,  VLMAXSTAR,  AQMAXSTAR,  and 
NCONSIST  all  had  the  value  4.  The  data  show  that  the  effect  is  more  than  a  linear  one,  with 
the  run  times  for  k=2  and  k=3  suggesting  a  quadratic  behavior.  If  the  times  were  to  typify  a 
quadratic  behavior,  the  time  for  k=4  should  be  135.5  rather  than  84.5.  It  is  possible  that  some 
diminution  in  time  comes  about  because  there  are  only  9  events  to  be  divided  into  4  classes.  In 
very  small  classes,  some  of  the  techniques  (e  g.,  seed  event  selection)  can  exhaust  all  possible 
choices  and  lead  to  quick  solutions.  The  expected  number  of  stars  built  by  NID  should  be 
proportional  to  k,  though  this  too  is  greatly  affected  by  the  events.  Since  the  time  per  star 
generation  also  rises  with  k,  the  net  effect  is  expected  to  be  of  second  order.7 


Number  of  classes: 

•7 

3 

4 

Run  time  (secs): 

35.1 

76.3 

81.5 

Number  of  stars  built  by  NID: 

6 

12 

12 

Time  per  star  (secs): 

5.8 

6.4 

7.0 

Figure  6.9.  Run  times  for  various  numbers  of  classes. 


6.7.3.  Breadth  of  search  versus  run  time 

The  three  parameters  ALTER,  VLMAXSTAR,  and  AQMAXSTAR  control  the  breadth  of 

search  conducted  through  the  solution  space  of  complexes  generated  in  the  process  of  building  a 

star.  For  empirical  study,  the  parameters  were  given  the  same  values,  either  2,  4,  or  8.  Fig. 

*  The  stir  G(e  F)  is  built  with  the  igiinst  set'  F  composed  of  It- 1  events  The  time  required  to  build  *  stir  is 
roughly  proportion*!  to  the  number  of  events  in  set  F 
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6.10  shows  the  run  times  and  number  of  stars  built  by  NID  for  the  blocks*world  problem  with 
k=2.  The  time  per  star  generation  shows  an  approximately  exponential  effect  in  parameter 
value.  The  total  run  time  is  not  necessarily  exponential  with  respect  to  parameter  value.  As  the 
search  breadth  is  increased,  there  is  a  tendency  for  the  quality  of  the  complexes  generated  to 
improve  and  lead  to  fewer  multiply  covered  events  for  NID  to  handle.  Since  NID  generates  a 
new  star  for  each  multiply  covered  event  for  each  class,  reducing  the  number  of  multiply 
covered  events  by  just  one  leads  to  a  reduction  by  k  in  the  number  of  stars  generated. 


Value  for  all  parameters: 

O 

4 

8 

Run  time  (secs): 

25.5 

35.1 

120.8 

Number  of  stars  built  by  NID: 

12 

6 

8 

Time  per  star  (secs): 

2.1 

5.8 

15.1 

Figure  6.10.  Run  statistics  for  3  values  of  parameters  ALTER,  VLMAXSTAR,  and  AQMAXSTAR. 


CHAPTER  7 


METHOD  3:  STRUCTURAL  TEMPLATE  CHARACTERIZATION 

7.1.  Overview 

This  chapter  presents  a  methodology  for  combining  parts  of  the  unstructured-example 
classification  building  algorithm  of  Chapter  5  with  parts  of  the  structured-example  classification 
building  algorithm  of  Chapter  6.  The  motivation  for  this  third  implementation  is  the  desire  to 
build  classifications  of  structured  objects  in  which  class  descriptions  will  be  disjoint. 

In  the  method  presented  in  the  preceding  chapter,  the  algorithm  NID  for  turning  non- 
disjoint  class  descriptions  into  disjoint  ones  was  not  actually  able  to  live  up  to  its  name.  In  cases 
where  it  is  not  able  to  adjust  the  class  descriptions  so  that  each  contains  a  selector  for  a  common 
zero-place  function  with  non-intersecting  value  lists,  the  algorithm  can  only  guarantee  to  adjust 
the  descriptions  to  make  them  weakly  intersecting  (i.e.,  intersecting  but  not  at  observed  events). 
This  is  explained  and  illustrated  in  Sec.  6,5.5.. 

The  methodology  of  this  chapter  is  based  on  a  decomposition  of  the  classification  building 
problem  into  parts:  finding  an  optimized  structural  characterization  of  the  problem  by  which 
quantifier-free  attributes  are  generated,  and  building  a  classification  based  on  the  generated 
attributes  using  the  methodology  of  unstructured  classification  building  of  Chapter  5.  Because 
the  unstructured  descriptions  are  quantifier  free,  a  disjoint  classification  will  be  obtained  in  all 
cases1.  It  should  be  noted  that  disjoint  class  descriptions  are  not  required  by  all  classification 
building  problems.  When  intersecting  classes  are  appropriate,  the  algorithms  of  Chapters  5  and 
6  may  be  performed  without  performing  procedure  NID  When  weakly  intersecting  classes  are 

1  Note  however  th»t  the  methodology  for  geoenting  clissificitioas  of  unstructured  examples  m»y  throw  out  some 
examples  19  'inomilies,'  is  described  in  Sec  &  2  5 
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appropriate,  the  algorithms  of  this  chapter  are  not  required,  but  they  may  be  more  efficient  than 
those  of  Chapter  6  because  much  less  work  is  necessary  to  build  classifications  of  attribute-based 
examples  than  graph-based  examples.  The  decomposition  by  structure  template  characterization 
does  add  additional  built-in  biases  to  the  solution  which  may  in  certain  cases  make  the  added 
costs  of  the  direct  approach  worthwhile. 

The  remainder  of  this  chapter  will  describe  the  method  used  for  generating  the  structural 
template;  how  it  is  used  to  derive  attribute-based  descriptions  of  the  examples,  and  how  they  are 
presented  to  the  previously  described  method  for  building  the  classification.  The  chapter 
concludes  with  an  example  problem  that  has  been  solved  by  both  the  presented  algorithm  and 
by  humans.  In  the  human  solutions,  the  subjects  generated  disjoint  classes.  This  is  taken  as 
partial  evidence  that  the  ability  to  generate  classifications  of  mutually  disjoint  classes  is 
necessary  in  order  to  attempt  to  attain  some  learning  skills  practiced  by  people. 

7.2.  Generating  attribute-based  descriptions  for  structured  examples 

The  process  of  building  classifications  by  structural  template  characterization  is 
implemented  in  the  program  CLUSTER/S.  That  implementation  is  the  amalgamation  of  the 
two  programs  CLUSTER/2  (able  to  build  disjoint  classifications  of  unstructured  examples)  and 
INDUCE/3  (able  to  build  weakly  intersecting  classifications  of  structured  examples).  The 
process  has  three  parts:  building  the  structural  template,  using  it  to  generate  attribute-based 
examples  from  structured  examples,  and  applying  CLUSTER/2  to  generate  a  classification. 

7.2.1.  Building  the  structural  template 

A  structural  template  T  is  a  complex  that  is  maximally  specific  and  covers  all 
examples.  Fig.  7.1  shows  three  biocks-world  figures  er  e  e.  and  their  structural  template  T. 
The  template  figure  is  composed  of  a  top  part  that  is  not  a  circle  and  another  part  beneath  it 
that  is  curved,  medium  sized,  and  shaded  The  template  description  (which  is  a  characteristic 
description  of  all  examples)  is  generated  by  forming  the  structured  REFUNION  of  all  examples. 


Events: 
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Structural  template  for  er  e4,  e?: 


3  P,.  P2.  (MOST-ontop(pj)l  (ontopfp^p,)} 
[shapefp^circle]  [shape(p„)*c  red) 
[size(p2)=medium]  [texture(2)=*shaded| 


non-circle, 
any  size, 
any  texture 


curved, 
medium  size, 
shaded 


Figure  7.1.  A  structural  template  for  three  blocks-world  figures. 


The  algorithm  for  structured  REFUNION  is  presented  in  Sec.  6.5.2. 

7.2.2.  Deriving  attribute-baaed  deseriptiona  for  structured  examples 

Given  structural  template  T  and  a  set  of  examples  E,  the  process  of  structural  template 
matching  (Sec.  6,4)  is  used  to  generate  a  set  of  attributes  xr  x,,  ...  x%  and  an  attribute  based 
description  for  each  example  in  E.  Some  examples  may  give  rise  to  more  than  one  attribute 
based  description  if  there  are  multiple  ways  to  match  the  template  to  the  example.  The  derived 
attribute-based  descriptions  describe  only  the  parts  of  the  structured  examples  covered  by  the 
template  structure.  Additional  steps  are  taken  to  add  descriptors  to  quantitatively  describe  the 
residual  structures  not  covered  by  the  structural  template. 


An  inventory  is  made  to  generate  descriptions  of  parts  not  covered  by  the  structural 
template.  For  the  three  example  figures  in  Fig.  7  1,  the  “u”-shape  part  of  figure  e(  is  not 
covered  by  the  template.  AH  such  structure  fragments  are  collected  and  separately  classified  by 
recursive  application  of  the  conceptual  clustering  method.  When  that  is  completed,  each  class  of 
structure  fragments  is  tagged  with  its  class  number  In  the  example  (which  is  trivial  with 
respect  to  building  a  classification  of  structure  fragments)  the  “u”-shape  fragment  would  be 
classified  into  fragment  class  1. 

For  each  connection1  of  fragments  to  a  part  covered  by  the  structural  template,  an 
attribute  is  created  called  “number  of  fragment  i  types  counected  to  part  j"  or  more  briefly 
“#iatj”  where  i  is  the  fragment  class  number  and  j  is  an  ordinal  that  uniquely  identifies  a  part 
in  the  structural  template.  V’alues  for  the  derived  fragment  connection  attributes  are  calculated 
and  appended  to  the  attribute  descriptions  of  the  examples.  In  the  case  of  the  illustration 
involving  the  examples  in  Fig.  7.1,  the  ordinal  for  the  second  part  in  the  template  is  2  and  the 
fragment  connection  attribute  is  denoted  “#1312'  which  stands  for  “the  number  of  class-1 
structure  fragments  connected  at  template  part  2.”  The  selectors  [#lat2=l],  [#lat2=0], 
[#lat2=0|  are  appended  to  the  attribute-based  descriptions  for  e  ,  e4,  and  e_,  respectively. 

Other  ways  exist  to  add  attributes  to  describe  the  structure  not  covered  by  the  template. 
A  set  of  conditional  attributes  may  be  generated  whose  value  sets  contain  the  two  additional 
values  knowable  and  unknowable.  Such  an  attribute  could  be  generated  for  a  selector  that 
contains  a  function  whose  argument  denotes  a  part  which  is  not  covered  by  the  structural 
template  and  which  is  not  present  in  all  examples.  The  value  set  of  a  conditional  attribute  is 
arranged  into  a  hierarchy  in  which  the  values  (or  hierarchy  structure)  for  the  underlying 
function  domain  are  all  subordinate  to  the  generalized  value  knowable.  The  value  unknowable  is 
also  added,  yielding  a  value  hierarchy  similar  to  the  one  shown  in  Fig.  7  2  that  was  built  from 

2  Connection  is  defined  o  terms  of  graph  structure  as  an  existentially  quantified  variable  node  for  a  part  covered  by 
the  structural  template  aod  another  for  a  part  not  covered  by  the  template  both  linked  to  a  common  selector  node 
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the  domain  of  the  function  shape. 

To  use  a  conditional  descriptor,  a  structure  template  is  constructed  that  fits  those 
examples  having  the  appropriate  structure  fragment.  The  process  of  template  matching 
determines  which  quantified  variable  denotes  the  part  described  by  the  conditional  descriptor. 
For  examples  which  do  match  the  structure  template,  the  conditional  descriptor  takes  its  value 
from  the  corresponding  selector  node  in  the  graph.  If  the  structure  template  matches  an 
example  in  more  than  one  way,  independent  attribute-based  descriptions  are  generated  for  each 


match.  For  examples  which  do  not  match  the  structure  template  (because  the  appropriate 
structure  fragment  is  not  present),  the  conditional  descriptor  value  unknowable  is  asserted.  The 
automatic  construction  of  conditional  descriptors  has  not  been  implemented  in  CLUSTER/S. 


,knowable 


opentop 


closed  top 


openrec  tangle 
opentrapazoid 
ushape 

doubleopen  rectangl 

hexagon 

ellipse 

closedrectangle 
jagged top 
slopetop 
engine 


unknowable 


An  augmented  value  hierarchy  for  the  conditional  descriptor  shape. 


Presently  such  descriptors  are  suggested  to  the  program  by  the  user. 


7.2.3.  Applying  unstructured  clustering  to  derived  attributes 

The  previous  section  described  the  method  used  to  derive  a  set  of  attribute-based 
descriptions  from  structured  descriptions  in  a  manner  that  focuses  attention  to  the  parts  of  each 
example  which  are  described  by  the  developed  structural  template.  Some  descriptive 
information  is  included  to  partially  characterize  the  structure  of  examples  which  is  not  universal. 
Though  not  explicitly  stated,  the  zero-place  functions  which  are  generated  by  the  application  of 
descriptor  construction  transformations  are  propagated  into  the  attribute-based  descriptions  and 
are  used  by  the  classification  building  process.  When  background  inference  rules  are  provided, 
they  are  processed  before  the  above  steps  so  that  selectors  they  may  generate  undergo  the  same 
structural  template  processing  as  selectors  that  are  initially  given. 

The  derived  descriptions  (that  are  quantifier-free)  are  processed  by  the  program 
CLl'STER/2  as  described  in  Chapter  S.  One  alteration  of  the  NID  procedure  used  by 
CLUSTER/2  is  necessary  to  enable  it  to  properly  repartition  derived  examples  based  on  the 
structured  example  they  represent.  This  ability  is  needed  only  when  the  template  matching 
finds  multiple  isomorphisms  for  an  example,  giving  rise  to  two  different  attribute-based 
representations  for  the  same  structured  example.  NID  must  take  care  to  arrange  for  all  such 

multiple  representations  to  be  placed  into  the  same  class. 

I 

7.3.  An  example  problem:  Classifying  toy  trains 

Consider  a  simple  example  based  on  rephrasing  the  problem  known  as  “East-  and  West- 

|  bound  trains"  [Larson,  1977;  Michalski,  1080a)  shown  in  Fig.  7.3.  In  the  original  formulation  of 

|  the  problem,  given  are  two  collections  of  trains,  those  that  are  “East-bound"  (A  to  E)  and  those 

[  that  are  “West-bound"  (F  to  J).  These  trains  are  highly  structured,  each  consisting  of  a 

> 

I  sequence  of  cars  of  different  shapes  and  sizes.  The  individual  cars  carry  a  variable  number  of 


loads  of  different  shapes. 


Figure  7.3.  How  would  you  classify  these  trains? 


Suppose  the  class  labels  are  removed  (as  in  Fig.  7.3)  and  the  problem  is  to  create  a 
meaningful  classification  of  the  collection  of  all  10  trains.  Research  on  this  problem  has 
investigated  both  human  solutions  and  those  produced  by  the  methodology  of  this  chapter.  Sec. 
7.3.1  below  describes  the  classifications  produced  by  humans  and  then  the  machine-generated 
solutions  are  discussed  in  Sec.  7.3.2. 


7.3.1.  Human  classifications  of  toy  trains 

Experiments  to  generate  human  classifications  of  the  toy  trains  were  conducted  by  Medin 
at  the  University  of  Illinois  Department  of  Psychology  [Medin,  Wattenmaker,  and  Michalski). 
The  ten  trains  (Fig  7.3)  were  placed  on  separate  index  cards  so  they  could  be  arranged  into 
groups  by  the  subjects  in  the  experiment.  Each  subject  was  instructed  to  partition  the  trains 
into  the  following  groupings  and  to  state  the  rationale  used 

Grouping  1:  Arrange  the  trains  into  any  number  or  groups  of  conceptually  similar 
objects. 

Grouping  2:  Arrange  the  trains  into  two  equal  groups  of  similar  objects. 

Grouping  3:  Arrange  the  trains  into  any  number  of  groups  of  conceptually  similar 
objects  plus  an  “other"  category  to  hold  any  unusual  or  hard  to  classify 
trains. 

The  experiment  was  completed  by  31  subjects  who  made  a  total  of  93  classification  schemes  for 
partitioning  the  objects.  The  most  popular  criterion  for  classification  (17  repetitions)  was  the 
number  of  cars  in  the  trains  (an  attribute  that  characterizes  each  train  as  a  whole  and  is  simple). 
The  three  clusters  formed  were:  trains  containing  2-cars,  3-cars,  and  4-cars,  respectively.  The 
second  most  frequent  classification  of  the  trains,  based  on  engine  wheel  color,  occurred  7  times. 
These  classifications  are  shown  in  Fig.  7.4.  Typically,  the  classifiers  used  by  the  subjects  in  the 
experiment  to  describe  the  classes  of  trains  were  concepts  expressed  as  the  conjunction  of 
selected  train  properties. 

Of  the  93  classifications  produced,  40  of  them  were  unique  to  one  subject  in  the 
experiment.3  Although  definite  conclusions  cannot  be  drawn  trom  a  single  experiment,  the  results 
suggest  that  in  the  absence  of  explicit  goals  for  a  classification,  there  exists  a  strong  pattern  of 
For  i  detailed  analysts  of  these  results,  see  , Media,  Wattenmaker  and  Michalski,  1984] 
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uniformity  along  with  a  wide  spectrum  of  singleton  solutions.  It  is  possible  that  human 
classifications  are  generated  to  satisfy  a  criterion  that  is  acquired  from  experiences.  Judging 
from  the  human  classifications,  machine  classification  methods  should  take  into  account  either 
explicit  goals  of  the  classification,  or  in  the  absence  of  explicit  goals,  a  syntactic  criterion  that 


biases  the  generated  descriptions  towards  simple  conjunctive  forms  that  people  prefer. 


7.3.2.  Weaknesses  of  the  east-bound  versus  west-bound  classification 


Before  presenting  the  solutions  obtained  using  the  method  that  employs  structural 
template  characterization,  consider  one  possible  solution  based  on  the  discriminant  descriptions 
of  East-bound  and  West-bound  trains,  as  found  by  Larson  using  the  program  INDUCE  [Larson, 
1977],  These  descriptions  are: 

East-bound  trains: 

“A  train  is  East-bound  if  it  contains  a  short,  closed  car.” 

West-bound  trains: 

“‘A  train  is  West-bound  if  it  contains  two  cars  or  if  there  is  a  car  with  a  jagged  top.' 

When  viewed  as  a  classification  involving  two  classes  (East-bound  and  West-bound),  the  above 
class  descriptions  are  atypical  of  those  produced  by  people  because  the  description  of  the  West¬ 
bound  trains  contains  disjunction.  By  breaking  the  description  of  West-bound  trains  at  the 
disjunction,  three  classes  described  by  conjunctive  concepts  are  generated: 

Class  1:  trains  that  contain  a  short,  closed  car; 

Class  2:  trains  that  have  two  cars; 

Class  3:  trains  that  contain  a  jagged-top  car. 

The  above  classification  is  still  in  a  form  that  is  not  typical  of  classifications  proposed  by  a 
person.  The  difference  is  that  people  tend  to  describe  classes  with  references  to  the  same 
attributes  (i.e.,  they  tend  to  propose  disjoint  class  descriptions).  In  this  classification,  one  class  is 
described  in  terms  of  the  number  of  cars,  another  class  is  described  in  terms  of  the  existence  of  a 
jagged-top  car,  and  a  third  class  is  described  in  terms  of  the  existence  of  a  short  car  of  a 
particular  shape.  The  descriptions  of  the  three  classes  are  not  disjoint. 

In  the  trains  of  Fig.  7.3,  there  is  no  observed  train  that  contains  a  short  closed  car  and  a 
jagged-top  car.  If  such  a  train  were  to  exist,  it  would  be  described  simultaneously  by  two  of  the 
above  class  descriptions.  This  indicates  that  the  descriptions  are  weakly  intersecting  rather  than 


disjoint.  When  people  are  asked  to  build  classifications,  they  typically  form  classes  with  disjoint 
descriptions,  as  in  the  study  mentioned  above.  Thus,  if  the  goal  of  the  clustering  process  is  to 
generate  classifications  similar  to  those  produced  by  people,  then  the  classes  should  be  described 
Lv  conjunctive  concepts  that  are  disjoint.  An  experiment  that  does  this  through  the  use  of  a 
structural  template  is  described  below. 

7.3.3.  Disjoint  classifications  generated  by  using  a  structural  template 

For  this  problem,  the  structured  descriptions  of  each  train  involve  the  descriptors  contains, 
infront,  number  of  cars,  number  of  wheels,  wheel  type,  car  shape,  car  length,  cargo  shape,  and 
number  of  cargo  items  carried.  For  example,  the  description  of  train  A  is 

3  t  ,  car(.  car„,  car3,  car4,  cars,  [containsjtl.carj]  [contains(tl.car„)| 

[contains(tl,car3)j  [contains(tl,car4j]  |contains(tl,car6)]  [number-of-cars(tl )=5] 
[infrontfcarj.car,,)]  [infrontjcar^carj)]  [infront(car3,car4)|  [infront(car4,ears)] 
[number-of-wheels(carl)=2|  (number-of-wheels(car„)s=2j 
[number-of-wheels(car3)=2|  [number-of-w heels(car4)=3) 

[number-of-wheels(cars)=2]  [wheel-type(car1)=blackj  [wheel-type(car„)=black] 
[wheel-type(car3)=black|  [wheel-type(car4)=black|  (wheel-type(car6)=blackj 
[car-length(car1)=long]  (car-length(car„)=long)  [car-length(car3)=short] 
[car-length(car4)=longj  (car-length{c3rs)=short|  [car-shape(carJ)=engine] 
[car-shape(car0)=open-rec tangle]  jcar-shape(car3)=slope-top| 

[car-shape(car4)=open-rec tangle]  [car-shape(car6)=open-rec tangle] 
[number-of-items-carried(car1)=0j  [number-of-items-carried(car„)=3] 
[number-of-items-carried(car3)=l|  (number-of-items-carried(car4)=  1] 
jnumber-of-items-carried(car5)=  1|  [cargo-shape(car.,)=rect3nge-lo3d| 
[cargo-shape(car3)=  triangle-load]  [cargo-shape(car4)=hexagon-load] 
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(cargo-shape(cari.)=circle-loadj. 

The  structural  template  for  the  trains  generated  by  applying  the  methods  presented  in  this 
chapter  is  the  description 

3  carr  car„,  cars,  jMOST-infront(car1)][infront(car1,car„)j 

[infront(car„,carJ)][car-shape(car1)=engine] 

which  identifies  the  engine  and  the  next  two  cars  in  each  train.  The  51  variables  derived  from 
the  above  structural  template  are  listed  in  Fig.  7.5.  Two  fragment  templates  fl  and  f2  were 


car-shape. car2 

car-shape. car3 

forall-cars(#wheels=2) 

foralI-cars(wheel-type=black) 

forall-cars(wbeel-type=clear) 

foralI-cars(cargo-shape=rectangle) 

length. car2 

length. car3 

cargo-shape.car2 

cargo-shape. car3 

#cars 

#cargo.car2 

#cargo.car3 

#wheels.car2 

S AME-#wheels  car  1  car2.car3 
SAME-wheel-tvpe.car  l.car2  car3 
wheel-type. carl 
wheeHype.car2 
wheel-type.  car3 

#cars(car-shape=closed  rectangle) 

#cars(car-shape=jaggedtop) 

#cars(car-shape=slopingtop) 

#cars(car-shape=opentop) 

#cars(car-shape=closedtop) 

#cars(car-shape=openrec  tangle) 

#cars(car-shape=opentrapazoid) 


#cars(car-sh  ape=ush  ape ) 
#cars(car-shape=doubleopen  rectangle) 
#cars(car-shape=hexagon ) 
#cars(car-shape=ellipse) 
#cars(length=short) 

#cars(length  =  long) 

#cars(cargo-shape=hexagon) 

#cars(cargo-shape=circle) 

#cars(cargo-shape=rectangle) 

#cars(cargo-shape=triangle) 

#cars(#cargo=0) 

#cars|#cargo=l) 

#cars(#cargo=2) 

#cars(#cargo=3) 

#cars(#wheels=2) 

#cars(#wheels=3) 

#cars(wheel-ty  pe=mixcd ) 
#cars(wheel-type=clear) 
#cars(wheel-type=black ) 
#different-car-shapes 
#d  ifferen  t-cargo-sh  apes 
#different-#cargo 
#d  ifferen  t-#wheels 
#d  ifferen  t-wheel-type 
LEAST-in  front.  ear3 


Figure  7.5.  Attributes  of  trains  derived  from  program-generated  structural  template. 
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used.  They  are 

fl:  3  carr  car„,  car3,  car<(  (MOST-infrontjcarj))  (infrontfcar^car,,)]  |infront(car„,car3) 

[infront(car3,car4)| 


f2:  3  carr  car„,  car3,  car4,  car6,  (MOST-infrontfcarj)]  [infront(car(,ear„)j 

[infront(car„,car3)|  (infront(car3,car4)|  jinfront(ear4,cars)) 

These  fragment  templates  were  used  to  give  rise  to  the  connected  structure  attributes  #lat3, 
#'2at3,  and  the  conditional  descriptor  attributes  car-shape. carl,  cargo-shape.car4,  #cargo.carl, 
#wheels.carl,  and  wheel-type. carl.  The  domains  of  each  of  the  conditional  descriptor  attributes 
was  augmented  with  knowable  and  unknowable  values  as  described  above.  With  these  7 
fragment  attributes  added  to  the  previous  51  attributes,  each  train  is  described  by  values  for  58 
derived  attributes. 

The  generated  attribute  descriptions  were  processed  using  a  classification  evaluation 
criterion  LEF  that  minimizes  the  number  of  attributes  used  in  a  description  ( minimum 
commonality),  and  maximizes  the  number  of  attributes  that  singly  discriminate  between  all 
classes  ( maximum  dimensionality).  Minimizing  commonality  tends  to  conflict  with  the  other 
criterion.  This  was  handled  by  specifying  a  high  tolerance  (95^0)  for  the  first  criterion  and  zero 
tolerances  for  the  second  one.  The  LEF  is  set  up  to  apply  the  first  criterion  to  filter  out  the  5% 
most  specific  solutions  (measured  terms  of  number  of  selectors)  and  then  to  select  a  solution  with 
the  greatest  number  of  discriminant  attributes. 

Classification  A.  shown  in  Fig.  7.6  was  generated  by  the  program  with  two  different  class 
descriptions.  The  top  class  (“there  are  2  different  car  shapes  in  the  train")  was  also  described  as 
“the  third  car  from  the  engine  (if  it  exists)  has  black  wheels."  The  bottom  class  (“there  are  more 
than  2  different  car  shapes  in  the  train")  was  also  described  as  “the  third  car  from  the  engine 
exists  and  has  white  wheels."  Classification  B.  in  Fig.  7.6  is  based  on  the  derived  predicate 
SAME-wheet-type.  Both  classifications  received  the  same  evaluation  criterion  score  and  were 
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A. 


B. 


Cl«j  1  'Wheels  on  ill  cif)  hive  the  ume  color* 


F. 


Cluj  2:  'There  ire  3  or  more  different  cir  ihipei  in  the  trim’  C!dj  2:  'Wheels  on  ill  cirs  do  not  hive  the  sime  color* 


Criterion  LEF:  minimize  commonality  with  95^  tolerance,  then  maximize  dimensionality 
Figure  7.6.  Two  sample  classifications  found  by  structural  template  characterization. 


considered  to  be  alternative  classifications  Solutions  of  the  kind  shown  in  Fig  7.6  are  appealing 
because  the  class  descriptions  are  disjoint  and  the  difference  between  classes  is  striking,  yet  not 
obvious  by  casual  inspection. 


7.3.4.  A  classification  using  an  additional  background  inference  rule 

It  is  possible  to  guide  classification  building  through  explicit  inference  rules  supplied  as 
background  knowledge.  Suppose  that  the  knowledge  base  has  been  augmented  to  include  an 
inference  rule  to  identify  trains  carrying  toxic  chemicals.  This  section  presents  a  classification 
generated  using  attributes  derived  by  the  application  of  such  an  inference  rule. 

Using  the  illustrations  of  the  trains,  a  toxic  chemical  container  is  identified  as  a  single 
sphere  (circle)  riding  in  an  open-top  car.  The  logical  inference  rule  (f-rule)  supplied  to  the 
program  is 

[con  tains(  train , car  )][car-shape(car)=opentop| 

[cargo-shape(car)=circle||number-of-items-carried(car)=l]  <■"=>  |toxic-chemicals(train)| 

In  the  above  inference  rule,  equivalence  is  used  to  indicate  that  the  negation  of  the  condition 
part  is  sufficient  to  assert  the  negative  of  the  consequence.  After  the  application  of  this  rule,  all 
trains  will  have  descriptions  containing  either  the  toxic-chemicals  predicate  or  its  negation.  The 
structural  template  generated  by  INDUCE/3  will  now  contain  the  additional  predicate  toxic- 
chemicals/train).  Other  relevant  inferences  that  bear  on  this  problem  are: 

•  toxic  chemicals  are  dangerous, 

•  dangerous  things  are  important, 

•  important  things  should  have  high  selection  value  (high  preference  score). 

The  classification  produced  in  this  case  is  shown  in  Fig.  7.7.  The  classification  criterion  used  to 
generate  this  classification  differs  slightly  from  the  criterion  used  for  the  results  in  Fig  7  6 
Instead  of  minimizing  commonality,  the  first  criterion  applied  is  maximizing  the  preference  of 
the  descriptions  and  the  derived  attribute  ■‘toxic-chemicals(train )"  is  given  a  large  preference 
score  (as  dictated  by  the  above  inference  chain)  to  reflect  us  importance  in  the  resulting 


descriptions. 
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‘truss  cirrying  'toxic'  chcmicxlj' 


'truss  sat  csnyisg  'toxic'  chemicxls* 


Criterion  LEF:  maximize  similarity  with  90%  tolerance,  then  maximize  dimensionality. 
Figure  7.7.  A  classification  produced  using  the  toxic  chemicals'  inference  rule. 


CHAPTER  8 


CONCLUSION 

8.1.  Summary 

Interesting  conceptual  patterns  in  data  have  been  discovered  by  automated  conceptual 
data  analysis  techniques  presented  in  this  thesis  that  learn  from  observation.  Such  learning 
mechanisms  play  important  roles  in  knowledge  acquisition  systems  used  for  problem  solving  and 
for  building  knowledge  bases  for  expert  systems.  Three  techniques  based  on  the  methodology  of 
conjunctive  conceptual  clustering  were  presented  in  Chapters  5,  6,  and  7.  The  underlying 
methodology  for  these  conceptual  clustering  methods  (presented  in  Chapters  3  and  4)  is  based 
on  both  the  initial  ideas  of  Michalski  (l980bj  and  the  collaborative  ideas  of  Michalski  and  Stepp 
[1983]. 

The  numerically  based  techniques  of  feature  extraction,  multi-dimensional  scaling,  and 
numerical  taxonomy  perform  data  analysis  functions  without  the  ability  to  provide  any 
conceptual  interpretations.  By  using  the  inductive  inference  technique  of  learning  from 
examples  in  a  fashion  patterned  after  dynamic  clustering,  a  general  methodology  for  conceptual 
clustering  has  been  produced.  This  methodology  proposes  that  objects  be  grouped  into  classes 
not  on  the  basis  of  a  mathematical  measure  of  similarity  but  on  the  basis  of  conceptual 
cohesiveness  that  takes  into  account  the  similarity  between  objects  and  also  surrounding  objects 
and  concepts  for  describing  collections  of  objects. 

Since  there  are  neither  “right"  nor  “wrong"  solutions  to  conceptual  clustering  or 
classification  building  problems,  some  goal  and/or  bias  of  the  clustering  process  is  necessary  to 
guide  the  problem  solution  towards  the  kinds  of  solutions  which  are  useful  or  interesting.  Such 


guidance  can  come  from  three  sources:  the  explicit  goal  of  the  process  expressed  using  a  LEF 
(the  classification  goal),  the  application  of  background  knowledge  to  produce  derived  goals,  and 
the  built-in  biases  of  the  algorithm 

Classification  construction  problems  occur  when  one  wants  to  organize  and  classify 
observations  according  to  underlying  conceptual  patterns.  Problems  of  this  type  include 
classifying  physical  or  chemical  structures,  analyzing  genetic  sequences,  building  taxonomies  of 
plants  or  animals,  characterizing  visual  scenes,  etc.  In  different  situations  an  adequate 
representation  may  be  attribute  based  (if  objects  do  not  have  structure)  or  it  may  be 
predicate/function  based  (if  objects  have  structure).  Problems  with  the  former  type  of 
representation  are  handled  by  the  method  presented  in  Chapter  5  for  clustering  unstructured 
objects.  Problems  with  the  latter  type  of  representation  are  handled  by  the  methods  presented 
in  Chapters  6  and  7  for  clustering  structured  objects. 

The  approach  taken  for  generating  classifications  has  the  advantage  of  depending  mostly 
on  the  descriptions  of  the  individual  events  (especially  the  differences  between  seed  events)  to 
suggest  the  concepts  that  may  be  relevant  for  describing  classes  of  events  as  a  whole.  This 
approach  is  hard-biased  (i.e.,  biased  by  built-in  hard-coded  algorithms)  by  the  representation 
language  (which  is  quite  general)  and  the  available  generalization  transformations  (which  are 
also  quite  general).  The  user  can  add  as  much  additional  soft-bias  (i.e.,  bias  by  problem 
statement  and  design)  as  desired,  based  on  the  definition  of  the  LEF,  the  definition  of  function 
domains  and  value  hierarchies,  and  supplied  background  knowledge  inference  rules. 

The  presented  methods  are  domain  independent  and  have  been  applied  to  a  wide  variety 
of  problems.  The  example  in  Chapter  5  was  an  application  of  the  method  to  the  problem  of 
discovering  classes  of  soybean  disease.  In  that  problem,  cases  of  diseased  soybean  plants  each 
described  by  35  attributes  were  grouped  into  four  classes.  The  classes  and  their  descriptions 
corresponded  to  four  diseases  recognized  by  plant  pathologists. 
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In  another  experiment  performed  by  Spackman  [Michalski,  Baskin,  Spackman,  1982|,  the 
method  was  used  to  build  a  classification  of  patients  with  various  craniosynostosis  syndromes. 
The  two-class  solution  consisted  of  one  group  of  patients  having  one  syndrome  and  another 
group  containing  a  mixture  of  patients  having  one  or  the  other  of  two  syndromes. 

The  presented  conceptual  clustering  method  has  also  been  used  to  build  classifications  of 
12  microcomputers  (Michalski  and  Stepp,  1983}  and  a  collection  of  100  Spanish  folksongs  (Stepp, 
1 980 j . 

8.2.  Area*  of  further  research 

In  solving  a  problem,  it  is  important  to  distinguish  between  constraints  that  are  part  of  the 
problem  and  those  that  are  imposed  by  the  process  of  obtaining  the  solution.  The  presented 
methodology  for  building  classifications  through  conceptual  clustering  has  inherent  constraints 
and  inherent  advantages.  The  discussion  will  include  analysis  of  the  types  of  classifications 
which  can  be  built,  model-driven  versus  data-driven  approaches,  the  application  of  background 
knowledge,  and  the  built-in  (hard)  biases  of  the  algorithms. 

8.2.1.  Typea  of  claaalflcatlona 

This  thesis  has  presented  classification  building  by  the  application  of  conjunctive 
conceptual  clustering  techniques.  The  hierarchical  classifications  which  are  produced  have 
classes  that  are  disjoint  and  class  descriptions  (complexes)  that  are  disjoint  or  only  weakly 
intersecting.  These  kinds  of  classifications  correspond  to  the  kinds  often  produced  by  people 
when  asked  to  create  a  classification  scheme  for  a  collection  of  objects  (Media,  IVattenmaker, 
Michalski,  1984|.  A  classification  with  disjoint  classes  is  not  the  only  kind  of  classification  which 
people  build,  however.  Other  kinds  can  be  considered. 


Interesting  patterns  in  collections  of  objects  may  involve  objects  belonging  to  more  than 
one  class  at  the  same  time.  For  example,  when  classifying  athletes,  the  classes  of  basketball 
players  and  baseball  players  may  be  good  ways  to  describe  the  collection  of  athletes,  but  these 
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two  classes  may  not  be  disjoint.  When  the  requirement  for  disjointness  is  removed,  the  goal  of 
the  classification  could  continue  to  be  optimizing  the  simplicity  and  fit,  i.e.,  trying  to  find  classes 
that  fit  the  data  well  (being  specific  enough)  while  also  being  simple  (being  general  enough).  The 
algorithms  presented  in  Chapters  5,  6,  and  7  can  generate  classifications  containing  non-disjoint 
classes  by  removing  the  NID  procedure  that  transforms  non-disjoint  complexes  into  disjoint 
ones 


8.2.2.  Model-driven  versus  data-driven  methods 

The  methodology  for  conceptual  clustering  is  a  mixture  of  model-driven  and  data-driven 
approaches.  The  data  (event  descriptions)  are  used  to  select  seed  events  and  to  drive  the  star 
generation  process,  constructing  hypothetical  class  descriptions  that  are  processed  as  necessary 


3 


by  NED  to  make  them  disjoint.  Once  the  class  descriptions  (models)  are  synthesized  via  star 
generation,  they  are  evaluated  according  to  the  LEF  and  the  best  ones  are  reported  as  final 
results.  Overall,  the  described  algorithms  are  more  data-driven  than  they  are  model-driven. 

An  approach  that  is  more  model-driven  is  certainly  possible.  If  simplicity  of  class 
descriptions  is  an  element  of  the  classification  goal,  a  model-driven  approach  could  select 
individual  descriptors  and  use  them  to  build  several  candidate  class  descriptions,  generated  in 
order  by  increasing  length.  It  would  try  a  number  of  descriptions  containing  1  selector;  then 
some  with  2  selectors;  etc.  The  algorithm  would  begin  by  selecting  an  initial  descriptor  whose 
value  set  can  be  partitioned  into  k  subsets.  This  descriptor  would  be  used  in  k  class 
descriptions,  each  using  a  different  value  subset  (thus  making  the  descriptions  disjoint).  Next, 
the  eveots  would  be  partitioned  to  match  the  descriptions  and  the  entire  clustering  would  be 
evaluated  with  respect  to  the  LEF.  The  process  would  be  repeated  using  different  descriptors 
and  different  numbers  of  descriptors.  The  model  which  scores  the  best  would  be  the  final  result. 

The  above  “model-driven'  approach  depends  on  heuristics  for  combining  descriptors  and 
for  knowing  when  to  halt.  Although  experimentation  has  not  been  conducted  on  this  type  of 
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approach,  it  is  reasonable  to  expect  the  heuristics  to  be  very  important  and  for  the  generated 
classifiers  to  reflect  the  imposed  heuristic  control.  Thus,  the  classifications  would  tend  to  match 
the  models  which  the  heuristics  promote,  rather  than  underlying  patterns  of  conjunctive 
concepts  in  the  data.  This  approach  would  be  good  when  building  a  classification  to  fit  into 
existing  theory,  while  the  •‘data-driven"  approach  as  presented  in  Chapters  5,  6,  and  7  is  better 
for  discovering  interesting  new  or  unexpected  conjunctive  concepts  in  the  data. 


8.2.3.  Application  of  background  knowledge 

The  application  of  background  knowledge  to  problems  of  unsupervised  learning  is  highly 
beneficial.  It  can  permit  the  construction  of  relevant  descriptors  from  descriptors  given  initially 
that  may  be  rather  irrelevant  by  themselves  to  the  conceptual  patterns  in  the  data.  In  the 
approach  outlined  in  Chapter  6,  background  knowledge  about  descriptor  domains  is  used  to 
guide  generalization  transformations  and  background  knowledge  in  the  form  of  background 
inference  rules  is  applied  to  events  before  the  actual  clustering  process  begins.  The  background 
inference  rules  are  used  to  augment  descriptions  of  the  events  by  adding  new  selectors.  Then, 
the  clustering  process  is  performed  using  augmented  event  descriptions. 

An  alternate  way  to  perform  clustering  in  problems  with  background  inference  rules  would 
be  to  adopt  the  model-driven  approach  above  and  to  use  a  backward-chaining  control  scheme  to 
work  backwards  through  the  background  rule  base  from  proposed  model  solutions  to  event 
descriptions  and/or  generalized  event  descriptions.  The  candidate  classification  schemes 
produced  would  then  be  evaluated  via  a  LEF,  with  the  best  classification  preserved  as  the  final 
result. 


8.2.4.  Built-In  biases  of  the  algorithms 

The  most  fundamental  built-in  biases  ( hard  bias)  of  the  algorithms  are  the  constraints 
imposed  by  the  choice  of  representation  language.  This  choice  affects  the  composition  of 
concepts  and  the  kinds  of  applicable  generalizing  and  specializing  transformations  which  can  be 
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applied  to  events. 

Although  conjunctive  concepts  are  a  natural  component  of  human  expression,  they  are  by 
no  means  the  only  descriptive  form  used.  The  advantage  of  the  conjunctive  concept  is  its 
expressiveness  coupled  with  its  ease  of  understanding  (especially  with  extensions  to  predicate 
logic  such  as  internal  disjunction)  and  ease  of  transformation  by  a  variety  of  inference  rules. 
The  constraint  of  conjunctive-only  concept  forms  could  be  removed  by  introducing  other  logical 
operators  (e.g.,  disjunction,  equivalence,  implication).  This  would  invite  the  introduction  of 
additional  inference  rules  for  applying  generalizing  and  specializing  transformations  for 
descriptions  involving  the  added  operators.  The  language  could  also  be  extended  with  statistical 
and  probabilistic  expressions  (e.g.,  relations  on  fuzzy  sets  [Zadeh,  1965j). 

Within  the  constraint  of  conjunctive  form  concepts,  there  are  additional  generalizing  and 
specializing  transformations  that  could  be  applied.  To  consider  one  such  change,  consider  an 
adaptation  of  the  closing  the  interval  rule.  This  transformation  generalizes  the  value  set  of  a 
linear-domain  function  until  it  contains  all  values  in  an  enclosing  interval  of  values.  It  is  an 
arbitrary  bias  of  the  algorithm  to  insist  that  the  generalization  be  one  interval,  rather  than 
many  intervals.  An  alternative  approach  is  to  determine  the  number  of  intervals  to  generate  by 
using  a  threshold  limit  on  the  number  of  missing  values  that  are  filled  in  to  complete  an  interval. 
The  intervals  would  be  arranged  in  such  a  way  that  the  given  observed  values  are  covered  with 
a  minimum  number  of  intervals  that  collectively  do  not  exceed  the  threshold  limit  on  the 
number  of  “filled-in"  values. 

8.3.  Promising  future  applications 

There  are  two  interesting  areas  of  future  research  where  the  presented  methods  of 
conjunctive  conceptual  clustering  can  be  applied  when  they  are  made  more  robust.  The  first 
area  of  application  is  self-organizing  (or  self-reorganizing)  knowledge-based  systems.  A  system 
can  collect  data  about  its  own  patterns  of  access  to  the  knowledge  store.  Conceptual  patterns  in 


this  data  can  be  used  to  help  structure  the  knowledge  layout  in  ways  that  accelerate  access.  As 
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intelligent  systems  demand  ever-increasing  amounts  of  knowledge  content,  our  ability  to 
manually  structure  the  knowledge  for  efficient  use  shrinks  in  relationship  to  the  size  of  the 
knowledge  base.  Worse  yet,  the  patterns  of  use  of  the  knowledge  are  not  constant,  so  periodic 
reevaluation  of  the  knowledge  base  layout  is  beneficial. 

The  second  area  is  a  variation  of  the  first.  Instead  of  operating  on  self-maintained  access 
data,  let  the  conceptual  analysis  tools  operate  on  the  knowledge  itself,  directed  in  part  by  the 
background  knowledge  in  the  database.  Important  conceptual  regularities  in  the  knowledge 
base  may  be  revealed  by  this  process  and  it  could  help  automate  the  scientific  inquiry  process. 
Just  as  one  mark  of  an  intelligent  system  is  an  ability  to  reason,  another  aspect  of  intelligence  is 
an  ability  to  observe  and  to  form  classifications  of  the  observations  based  on  available 
background  knowledge  in  a  current  world  model.  The  work  described  in  this  thesis  begins  a 
course  of  research  towards  finding  algorithms  to  be  used  to  construct  such  systems. 
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APPENDIX  A 


REDISCOVERING  CLASSES  OF  SOYBEAN  DISEASE 


A.l.  Problem  description 

Given  are  47  cases  of  soybean  disease.  The  cases  come  from  four  disease  categories 
recognized  by  plant  pathologists:  Diaporthe  Stem  Canker  (events  1  to  10),  Charcoal  Rot 
(events  11  to  20),  Rbizoctonia  Root  Rot  (events  21  to  30),  and  Phytophthora  Rot  (events 
31  to  47).  These  categories  were  hidden  from  the  clustering  program.  Each  case  of 
soybean  disease  is  described  by  35  attribute/value  pairs.  The  attributes  used  in  the 
experiment  and  their  domains  are  given  below.  In  the  listing  of  input  data  which 
follows,  the  values  are  coded  as  integers,  according  to  the  mappings  noted  in  the 
description  of  each  attribute. 

1.  time_of_occurrence  (linear)  7  values:  0:april  l:may  2:june  3:ju!y  4:august 

5:september  6:october 

2.  plant_stand  (nominal)  2  values:  0:normal  l:less_than_ normal 

3.  precipitation  (linear)  3  values  0:below_normal  l:normal  2:above_normal 

4.  temperature  (linear)  3  values:  0:below_normal  l:normal  2:above_normal 

5.  occurrence_of_hail  (nominal)  2  values:  0:no  l:yes 

6.  number_years_crop_repeated  (linear)  4  values:  0:none  Pone  2:three 

3:four_or_more) 

7.  damaged_area  (nominal)  4  values:  0:scattered_areas  l:low_areas  2:upland_areas 

3:wbole_fields 


8.  severity  (linear)  3  values:  O:minor  1  potentially  _severe  2:severe) 

9  seed_treatment  (nominal)  3  values:  0:none  l:fungicide  Mother 
10,  seed_germination  (linear)  3  values:  0:90*0-100*0  1.80*0-89*0  2:less_lhan_80*o 
11  plant_height  (nominal)  2  values:  0:normal  l:abnormal 

12.  leaf_condition  (nominal)  2  values:  O.normal  1  abnormal 

13.  leaf_spots—  halos  (nominal)  3  values:  0:absent  l:witb_yellow_haIos 

2:without_yellow  _halos 

14.  leaf_spots— margin  (nominal)  3  values:  0:water  soaked  l:not_water  soaked 

2:does_not_apply 

15.  size_of_leaf_spots  (nominal)  3  values:  0:less_than_one_eighth Jnch 

l:greater_than_eighth Jncb  2:does_pot_apply 

16.  shot_hol*ng  (nominal)  2  values:  0:absent  l:prescnt 

17.  leaf_malformation  (nominal)  2  values:  0:absent  l:present 

18  leaf_mildew_growth  (nominal)  3  values:  0:absent  l:upperjcaf_surface 
2:lower_leaf_surface 

19.  condition_of_stem  (nominal)  2  values:  0:normal  l:abnormal 

20.  stemjodging  (nominal)  2  values:  0:absent  l:present 

21.  stem_cankers  (nominal)  4  values:  0:absent  I:beiow_soil  2:slightIy_above_soii_line 

3:above_£econd_node 

22.  canker Jesion_color  (nominal)  4  values:  0:does_not_apply  1. brown 

2:dark_brown_or_black  3:tan 

23.  fruiting_bodies_on_stem  (nominal)  2  values.  O.absent  l:present 

24.  outer_stem_decay  (nominal)  3  values:  0:absent  l:firm_and_dry  2:watery_and_soft 

25.  mycelium_on_stem  (nominal)  2  values:  0:absent  1  .-present 

26.  internal_discoloration_of_stem  (nominal)  3  values:  0:none  l:brown  2:black 


27  sclerotia— internal_or_external  (nominal)  2  values:  0:absent  l:present 

28.  fruit_pod_condition  (nominal)  4  values:  0:normal  l:diseased  2:few_or_none 

3:does_not_apply 

29.  fruit_spots  (nominal)  5  values:  0:absent  l:colored_spots  2:brown_spots_btaek_?peeks 

3:distorted  pods  4:does_not_appIy 

30.  seed_condition  (nominal)  2  values:  Omormal  l:abnormal 

31.  seed_mold_growth  (nominal)  2  values:  0:absent  l:present 

32.  seed_discoloration  (nominal)  2  values:  Orabsent  l:present 

33.  seed_size  (nominal)  2  values:  0:normal  l:smaller_than_normal 

34.  seed_shriveling  (nominal)  2  values:  0:absent  l:present 

35.  root_condition  (nominal)  3  values:  0:normal  l:rotted  2:galls_or_cysts 

A.2.  Input  data  file 

1  "SOYBEAN  EXAMPLE  Dl,  D2,  D3.  D4*  Thu  tpecifiet  the  title  o/  the 

example 

Th ii  table  tpecifiet  that  i 
clatiei  are  to  be  produced 
(k/=l)  and  givet  icttingi  / or 
the  /topping  criterion 
(bate^t,  probe^i)  and  cer¬ 
tain  depth  limili  ]or  the  PRO 
eearch  (ht «=?,  h!**l,  h3**!) 
The  ntd/pe  cd**/low  letting 
ueee  the  regular  NID  algo¬ 
rithm  Criterion  F  it  defined 
below 

Thu  table  epecifiet  the  LEF  to 
be  u ted.  The  only  elementary 
criterion  uted  it  tpar tenet! 


VARIABLES 
It  TYPE  LEVELS 

1  L  7 

2  N  2 

3  L  3 

4  L  3 

5  L  2 


F-CRITERION 

#  CRITERION  TOL 
1  SPARS  0 . 0 


PARAMETERS 

TRACE  K  HI  H2  H3  BASE  PROBE  CRITERION  NIDSPEED 
ON  4  2  1  2  2  2  F  SLOW 


Thu  table  givet  the  type  of 
each  variable  (attribute)  at 
N-nominal  or  Lhnear  and 


k 


menu  flevelij  tn  the  domatn 


EVENTS 

XI  X2  X3  X4  X5  X6  X7  X8  X9  X10  XI 1  X12 


1  1 


1  0  2  0  2  1  1 

10  3  1112 

1110  10  2 
2  13  3  112 

2  0  13  110 


The  eventi  table  define!  each 
eaie  of  dneaied  loybeani 
The  table  it  preiented  in  three 
parti,  one  with  attnbutei  Xl 
to  Xtt,  one  with  attnbutei 
XlS  to  XU,  and  one  with  at¬ 
tribute!  XC5  to  X35 


VI 


H 


A.3.  Generated  output 

The  output  generated  from  the  above  input  data  is  shown  below.  Although  the 
goal  of  this  research  is  not  strictly  directed  at  reproducing  human  classifications  of 
events,  comparisons  of  machine  and  human  classifications  is  an  interesting  part  of  the 
work.  In  this  example,  events  1  to  10,  11  to  20,  21  to  30,  and  31  to  47  were  classified 
as  the  same  soybean  disease  by  human  plant  pathologists.  In  the  machine  classification, 
these  same  categories  are  reproduced. 


CONJUNCTIVE  CONCEPTUAL  CLUSTERING  PROGRAM  CLUSTER,  2  LAST  UPGRADE  04/10/84 
PARAMETERS 

MINK  MAXK  TRACE  HI  H2  H3  INITMETHOD  NIDSPEED  C0VERTYPE  CRITERION  BASE  PROBE  BETA  MAXIIEICHT  MINSIZE 
2  4  ON  2  t  2  RANDOM  SLOW  HIERARCHIAL  F  2  2  3  0  2  4 

F -CRITERION 

«  CRITERION  TOLERANCE 
1  SPAR  0  00 

SOYBEAN  EXAMPLE  FROM  CHAPTER  5 


EXPERIMENT  1  X=2.  CRITERION=F 


The  class* 3  in  the  first  level  of 


herb  iravncn  113  cn  nL'rWUni  SvivSVft!i'  SvAiWIllvi'iSWiS'ftvt' 


INTERMEDIATE  RESULTS 

ITER/CLASS#  VL-RU1£  SEED  —COSTS— 

SPAR 

1  t  [X7=0. 1.2! 1X8=1  2] 1X9=011X11=1! 1X13=0! 1X14=2]  I  1  IE* 008 

1X15=2] 1X16=0] 1X17=0] 1X18=0!  CX19= 1 3  (X21=0, 1.3] 

1X24=0. 1 ] 1X26=0,2! 1X28=0.3] 1X29=4] 1X30=0] 

[X3 1 =0 i . X32=0J  ,X33=0| ,X34=0] 1X35=0.1! 

EVERTS  COVERED  1,4,6.7,10.13,14.18,18,20.22,23.28.27.28,29.32. 
33,38,39.40.42.45.46 

1  2  1X7=0. 1 .3] 1X8=1  2'  1X9=1!  1X11=1]  1X13=0]  1X14=2!  2  1  5E-008 

1x15=2;  ;xi8=oi :xi7=oi :xis=o] 1x19=1! 1x24=0, 11 

1X26=0.2! 1X28=0,3] ,X29=4] 1X30=0! 1X31=0] 1X32=0! 

:X33=0] :X34=0] 1X35=0, l! 

EVERTS  COVERED  2.3.5.8.9.11.12.15.17.19.21.24.25,30.31.34.35. 

37.38.41.43.44.47 

1  TOTALS  2  6E-008 

(1221  MS) 

2  t  1X3=211X4=0  1]  1X7=0. l! 1X8=1  2! 1 X9=0. 1 ]  CXI  1= 1 ]  23  1  4E*006 

1X13=0] ;X14=2] 1X15=2] [X18=01 1X17=0] 1X18=0] 

: x i 9= i : :x2i=i.3] 1x22=0.11 ;x24=t: 1x28=03 ;x27=oi 
;X28=0.3i 1X29=4] :X30=0] [X31=0] 1X32=0! 1X33=0! 

;X34=0]  ;X35=0, 1] 

EVERTS  COVERED  I .2. 3. 4 . S . 8 .7 . 8. 9. 10.21 .22.23.24 . 23. 28.27. 28 .29. 30 
2  2  1X7=1 .2.3] 1X8=1  2! ;X9=0. 1] [XI 1= 1 3 [X12=ll  31  1  4E-007 

:X13=0! ;X14=2! 1X15=2! ;X18=0! 1X17=0! 1X18=0] 

:xi9=l! :X21=0. 1.2! ;X22=2.3! 1X23=0] [X24=0 , 1) 

:x25=o: :X28=0.2! :X28=0.3] [X29=4] 1X30=0! [X31=0] 

X32=0! ;X33=0] [X34=0] [X35=0, 1] 

EVERTS  COVERED  11.12.13.14.15.18.17.18.19.20.31.32.33.34.35. 

36.37.38.39.40.41.42.43.44.45.48.47 

2  TOTALS  1  5E-007 

(2885  MS) 

3  1  !X1=3  6]  1X2=0! 1X4  =  1  2! 1X8=1  2! 1X9=0. 1)  8  1  8E-006 

;xtl=l! 'X 12  =  1 1  'X 13=0 ]  [X14=2] :X15  =  2] 1X18=0] 

;X17=0! 1X18=0] :X19=1! ;X21=0.3] 1X22=0.1.3] 

:X24=0.l! !X25=01 1X26=0.2] :x28=0! ;x29=4) ;X30=0] 

:X31=0! ;X32=01 :X33=0] :x34=0] :X3S=0I 

EVERTS  COVERED  1,2.3.4.5.8,7.8.9.10.11.12,13,14.15.18,17.18.19  20 
3  2  :xt=0  411X3=1  2! :X4=0  1] 1X7=1 .3] 1X8=1  2]  31  9  8E-005 

;x9=o.  i:  :xn=i:  cxi 3=01  :x  1 4=2;  :x  15=2!  :xi«=oi 

'X17=0!  1X18=0!  1X19=1]  lX21=t.2]  1X22=1.2]  :x23=0! 

1X24=0.1; 1X26=0: ;X27=0! ;X28=3! 1X29=4! ;X30=0] 

1X31=0! [X32=0! [X33=0! 1X34=01 1X35=0, U 

EVERTS  COVERED  21.22.23.24,25.28.27.28.29.30.31.32,33.34.35. 

38.37.38.39.40.41.42.43.44.45.48.47 

3  TOTALS  2  8E*008 

(2830  MS) 

4  1  :xi=3  61 :X2=0] :X4=l  2):X8=1  2! 1X9=0. l!  19  1  8E*008 

:xn=i;  1x12=1:  ;xi3=o:  ;xm=2]  1x15=2:  ;xis=oi 
:xi7=o! ;xi8=oi :xi9=t; ;x2i=o, si ;x22=o, 1.3; 

;x24=0.l! 1X25=0! 1X26=0. 2! 1X28=0] [X29=4! 1X30=0) 

1X31=0! 1X32=0]  1X33  =  0]  1X34=0;  1X35  =  01 

EVERTS  COVERED  1 . 2. 3. 4. 5 .8.7 .8 . 9 . 10. 1 1 . 12. t3. 14 , 15. 18 . 17. 18 . 19 . 20 
4  2  1X1=0  4! 1X3=1  211X4=0  1 ! 1X7= 1 . 3j 1X3=1  2]  38  9  8E-005 

1X9=0. ll [XI 1=1) 1X13=01 1X14=2! 1X15=21 1X16=0! 

1X17=0; 1X18=01 1X19=11 1X21=1.21 1X22=1 .21 1X23=0! 

1X24=0.1] 1X28=0] 1X27=0] 1X28=31 1X29=4] ]X30=0! 

1X31=0] 1X32=0] 1X33=0! 1X34=0! 1X35=0,11 

EVERTS  COVERED  21.22.23.24.25.28.27.28.29.30.31.32.33,34.35. 

38.37.38.39.40.41.42.43.44.45.48.47 

4  TOTALS  2  8E-008 

(3118  MS) 


the  hierarchy  are  about  to  be 
generated  by  cluttering  with  k 
varying  from  !  to  f  The  two 
teed  eventi  are  arbitrarily 
teleeted  at  the  firtt  two 
eventi  The  event  numbert  of 
the  teedt  are  luted  in  the 
column  marked  SEEDS  The 
SPAR  column  yivet  the 
iparienest  of  each  comptei 
The  hit  event  numbert  of 
covered  eventi  it  given  follow¬ 
ing  each  clan  deicnption 


Thu  it  the  tecond  iteration 
Notice  the  decreate  in  total 
ipane  nett  n  nee  the  firtt 
iteration 


Thu  it  the  third  iterationi 
Another  big  improvement  in 
total  tpartenen  take t  place 


The  fourth  iteration  doet  not 
net  an  improvement  in  total 
tpareenete  Thu  iteration 
count!  agomtt  the  PRCBE 
iteration t  count  which  it  tel 
by  input  declaration  to  ? 


5 


1  1X1=3  8i  1X2=0]  1X4=1  211X8=1  21  1X9  =  0.11 


17 


1  8E-008 


Again  no  improvement  in  total 


f  X 1 1  —  1 J £X12=1 J 1X13=0] [X  14=2] 1X15=2] 1X18=0] 

1X17=0]  [ X 1 8  =  0 i  1X19=1]  1X21=0.3] 1X22  =  0, 1.31 
1X24=0, 11 [X25=01 1X26=0,21 1X28=0] 1X29=4] 1X30=0] 

1X31=0! 1X32=0] [X33=0l 1X34=0] 1X35=01 

EVENTS  COVERED  1.2.3.4,5,6,7,8,9,10,11.12.13.14,15.16,17.18,19,20 
5  2  [X1=0  411X3=1  211X4=0  1] 1X7=1 .3][X8=1  2]  46  9  8E»005 

1X9=0,11 [Xll=l] 1X13=01 [X14=2] [X15=2] 1X16=01 
[X17=01 1X18=0] [X19=l] 1X21=1.2! 1X22=1.2] 1X23=0] 

1X24=0.1] [X26=0] 1X27=0] 1X28=3] 1X29=4] [X30=0] 

1X31=0] 1X32=0] [X33=0] 1X34=0] [X3S=0. 1] 

EVENTS  COVERED  21.22.23.24,25.26,27,28.29.30.31.32.33.34.35. 

36.37.38.39.40.41.42.43.44.45.46.47 

5  TOTALS  2  8E*006 

(2818  MS) 

THE  2  BEST  CLUSTERINGS  FOLLOW  (13102  MS) 

ITER/CLASS*  VL-RULE  SEED  — COSTS - 

SPAR 

3  1  [Xl=3  6] 1X2=0] 1X4=1  2] 1X8=1  211X9=0.1]  6  1  8E*006 

[XI 1=1] [X12= 1 ] [X13=0] 1X14=2] 1X15=2) 1X16=0] 

1X17=0] 1X18=0] [X19=l] 1X21=0.3] 1X22=0,1,3] 

1X24=0.1] 1X25=0] 1X26=0.2! 1X28=0] 1X29=4] [X30=0] 

1X31=01 [X32=0] 1X33=0] 1X34=0] 1X35=0] 

EVENTS  COVERED  1.2.3.4.5,6.7.8.9.10.11.12.13,14.15.16.17.18.19,20 
3  2  1X1=0  4] 1X3=1  2] 1X4=0  111X7=1.3)1X8=1  2]  31  9  8E-005 

1X9=0. 1] 1X11=1] [X13=0] 1X14=2] [X15=2] [X16=0] 

1X17=0] 1X18=0] [X19=l] 1X21=1.2! 1X22=1.2] [X23=0! 

1X24=0. 1] 1X26=0] [X27=0] 1X28=3] 1X29=4] [X30=0] 

1X31=0] 1X32=0] 1X33=0] 1X34=0] 1X35=0.1] 

EVENTS  COVERED  21.22.23.24.25.26.27.28.29.30.31.32.33.34.35, 

36.37.38.39.40.41.42.43.44.45.46.47 

3  TOTALS  2  8E‘006 

2  1  1X3=211X4=0  1) [X7=0. 1] 1X8=1  21 1X9=0. 1] 1X1 1=1]  23  1  4E*006 

1X13=0] 1X14=2] [X15=2] [X16=0] 1X17=0] 1X18=0] 

1X19=1) 1X21=1.31 1X22=0, 1] (X24=l! 1X28=0] 1X27=0] 

1X28=0.3] 1X29=4] [X30=0] 1X31=0] 1X32=0] 1X33=0) 

1X34=0] 1X35=0,1) 

EVENTS  COVERED  1.2.3.4.5.6.7,8.9.10.21.22.23.24.25.26.27,28.29.30 
2  2  1X7=1,2.31 1X8=1  2] 1X9=0. ti 1X11=1] [X12=l]  31  1  4E-007 

1X13=0] 1X14=2] [X15=2] 1X16=0] 1X17=0] [X18=0] 

[X19=t] 1X21=0.1.2] 1X22=2,3] 1X23=0! 1X24=0,1] 

1X25=0] 1X26=0.2] 1X28=0,3] 1X29=4] 1X30=0) 1X31=0] 

[X32=0] [X33=0] [X34=0] 1X35=0,1] 

EVENTS  COVERED  11.12,13,14.15.16,17.18.19,20,31,32.33.34.35. 

36.37.38.39.40.41.42.43.44.45.46.47 

2  TOTALS  1  5E*007 

(15  STARS  BUILT) 

FOR  THE  BEST  SOLUTION  ABOVE,  S=  2  2E-007 


EXPERIMENT  t  X=3.  CRITERION=F 
INTERMEDIATE  RESULTS 

ITER/CLASS*  VL-RULE  SEED  — COSTS - 

SPAR 

1  1  1X3=2] 1X4=0.  1] (X7=0. 1] 1X8=1  21 1X9=0 . 1 1 1X10=2]  1  1  IE-005 

1X11=11 1X13=0] [X14=2! 1X15=2] 1X16=0] 1X17=0] 

1X18=0] 1X19=1] 1X21=1,3] 1X22=1! 1X24=1] 1X28=0] 

1X27=0] 1X28=0.3] 1X29=4! 1X30=01 1X31=0] 1X32=0) 

1X33=0! 1X34=0] 1X35=0] 

EVENTS  COVERED  1,6,10.21.22.25.28,29 
2  1X3=2] 1X4=0  1] 1X7=0. 1] 1X8=1  2] 1X9=0. l! 

1X10=0  1] 1X11=1] 1X13=01  X14=2:  X15=2; ' X 16=01 


sparseness  This  is  the 
second  probe  iteration  and  the 
program  halts  because  the 
probe  count  i«  exhausted 


The  following  summary  report 
gives  the  two  best  clusterings 
found  for  k**! 


This  is  the  value  for  the  for¬ 
mula  S  »  sparseness  X  k“ 0, 
where  0  has  the  value  5 

Now  the  process  is  repealed 
for  k**3 


The  first  iteration 


1 


2 


4  6E-005 


ixi7=o:  :xi8=oi tx 1 9= i ]  1x21=1.3!  1x22=1: 1x24=1 ’ 

:X28=0!  1X27=0]  1X28=0 . 3]  1X29=4] 1X30=0!  1X31  =  0] 

1X32=0] 1X33=0] 1X34=0! 1X35=0.1) 

EVENTS  COVERED  2.5,7.23.24,28.27.30 
3  1X8=1  2] 1X9=0, 1) 1X11=11 IX12=l! 1X13=0)1X14=2!  3  74E-007 

1X15=2] 1X18=0] 1X17=0] 1X18=0] 1X19=1] 1X22=0.2.3] 

1X24=0.1] 1X25=0] 1X28=0.2! 1X28=0.3] 1X29=4] 

[X30=0] 1X31=0] 1X32=0] 1X33=0) [X34=0] 1X35=0, 1) 

EVERTS  COVERED  3.4.8.9.11.12.13,14.15.18.17.18.19.20.31.32.33. 

34.35.38,37.38.39, 40.41.42.43.44.45.48.47 
TOTALS  7  5E-007 

(3980  MS) 


1  1X1=0  4] 1X3=2] 1X4=0] 1X7=1] 1X8=1  2] 1X9=0. 1]  22  2555 

1X10=1  2] 1X11=1] 1X13=0] 1X14=21 1X15=21 1X16=0] 

[X17=0] 1X18=0] [X19= l ] 1X21=1] 1X22=1] 1X23=0] 

1X24=1] 1X25=1] 1X26=0] [X27=0] 1X28=3] 1X29=4] 

1X30=0] 1X31=0] 1X32=0] 1X33=0) 1X34=0! 1X35=0] 

EVENTS  COVERED  22.24.28.28.29 

2  1X3=211X4=0  1] [X7=0. 1] 1X8=1  2] 1X9=0. 1 ] 1X1 1= 1 ]  30  89E*00S 

1X13=0] 1X14=2] [X15=2] 1X18=0] 1X17=0] 1X18=0] 

1X19=1] 1X21=1.3] 1X22=0.1] 1X24=1] 1X25=0] 1X28=0! 

1X27=0] 1X28=0.3] 1X29=4] 1X30=0] 1X31=0] 1X32=0) 

1X33=0] 1X34=0] 1X35=0.1] 

EVENTS  COVERED  1.2.3.4.5.8.7.8.9.10.21.23.25.27.30 

3  1X7=1 .2.3] [X8= 1  2] (X9=0, 1] 1X11=1] 1X12=1]  31  1  4E-007 

1X13=0] [X14=2] 1X15=2] 1X16=0] 1X17=0] 1X18=0] 

1X19=1] 1X21=0.1.2! 1X22=2.3] 1X23=0! 1X24=0.1] 

[X23=0] 1X26=0.2!  1X28=0.3]  1X29=41  1X30=0] 1X31  =  0! 

1X32=0! 1X33=0] 1X34=0] 1X35=0.1] 

EVENTS  COVERED  I ! . 12. 13. 14 . 15 . 18 . 17 . 18 . t 9. 20 . 31 . 32 . 33 . 34 . 35 . 
38.37,38.39.40.41 .42.43.44  45.46.47 
TOTALS  1  SE-007 

(4767  MS) 


The  teeond  iteration  The 
ipartenett  teore  improver 


1  1X1=0  4] 1X3=2] 1X4=0] 1X7=1] 1X8=1  211X9=0.1]  22  10E*004 

1X10=1  2] 1X11=1] 1X13=0] 1X14=2] 1X15=2] 1X18=0] 

[X17=0] 1X18=0] 1X19=1] 1X21=1! 1X22=1] 1X23=0] 

1X24=1] 1X26=01 1X27=0] 1X28=3] 1X29=4] 1X30=0! 

1X31=0] 1X32=0] [X33=0 ! 1X34=0] 'X35=0.l! 

EVENTS  COVERED  21.22.23,24.25.26.27.28.29,30 

2  [Xl=3  6]  1X2=0]  1X4=1  2!  1X8=1  211X9=0.1!  2  1  8E-006 

1X11  =  1]  1X12=1]  1X13=0]  1X14  =  2]  1X15=2!  1X16  =  0] 

1X17=0] 1X18=0] IX 19= l! 1X21=0.3] 1X22=0. 1.3] 

1X24=0.1] 1X25=0) 1X26=0,2] 1X28=0] 1X29=4] 1X30=0) 

1X31=0] [X32=0] 1X33=0] 1X34=0] 1X35=0] 

EVENTS  COVERED  l .2. 3. 4 . 5.8.7. 8. 9, 10. 1 1 . 12. 13. 14 . 15. 18. 17 . 18  1 9 . 20 

3  1X1=0  3]  [X2=t]  1X3=1  2!  1X4=0  1.’1X7  =  I.3!  3!  2  SE-004 

1X8=1  2] 1X9=0. 1] 1X11=1] 1X12=1] 1X13=0] 1X14=2! 

1X15=2] [ X 16=0 ] 1X17=0] 1X18=0] 1X19=1! 1X21=1,2! 

1X22=2] 1X23=0] [X24=0, 1] 1X25=0! 1X26=0] [X27=0! 

1X28=3] 1X29=4] 1X30=0! 1X31=0] 1X32=0] 1X33=0] 

1X34=0]  1X35=1] 

EVENTS  COVERED  31.32.33.34.35.36.37,38.39.40.41.42.43.44.45.46.47 
TOTALS  1  8E<006 

(4862  MS) 

1  1X3=211X4=0  1] 1X7=0. 1] 1X8=1  2  1X9=0. t ] 1X11=1]  22  69E-005 

[X13=0] 1X14=2] 1X15=2] 1X16=0] 1X17=0] 'Xt8=0] 

1X19=1!  1X21  =  1.3!  1X22  =  0.1! 1X24  =  1 !  1X28  =  01  1X27  =  0! 

1X28=0.3] 1X29=4] 1X30=0! 1X31=0; 1X32=01 1X33=0! 

1X34=0! 1X35=0] 

EVENTS  COVERED  1 .2.3. 4.5.6. 7 .8 . 9. tO. 21 .22. 23. 24 . 25. 26 . 28. 29 . 30 

2  1X1=3  6] 1X2=01 1X3=0]  1X4  =  1  2!  1X7  =  2 . 31  ]X8= 1 1  19  1526 

*X9=0 . 1] 1X11=1] 1X12=1! 1X13=0! 1X14=2! 1X15=2! 

1X16  =  0!  1X17=0!  1X18=0]  1X19=1]  1X21=0]  1X22=3] 

1X23=0] 1X24=0] 1X25=0! 1X26=2! 1X27=1] 1X28=0] 

1X29=4;  1X30=0]  1X31=0!  1X32=0]  1X33=0]  X34  =  0] 

1X35=0] 


The  third 

ipartenett 

again 


iteration  The 
teore  improve* 


The  fourth  iteration  The 
ipartenett  teore  again  im¬ 
prove* 


■’HW 


EVENTS  COVERED  11. 12. 13. 14. IS. 18. 17, 18. 19.20 
3  1X1=0  3',  1X2=1!  1X3=1  2:  1X4=0  I ! 1X7= 1.3!  31  9  8E»004 

lxs=i  2:  ;x9=o. 1: 1x11=1: :xi3=o; 1x14=2) 1x15=2; 

:xi8=o;  :xi7=oi  :xis=o:  :xi9=n  1x21=1,2]  1x22=1.2] 

:X23=0! 1X24=0.1] :X25=o; 1X28=0! :X27=0i 1X28=3] 

1x29=4] :x3o=oi :x3i=o: 1x32=01 :x33=o; 1x34=01 

1X35=1] 

EVENTS  COVERED  27 . 31 , 32. 33. 34 . 35 . 38 . 37 , 38 . 39 . 40  4 1 , 42. 43. 44 . 
45.48.47 

TOTALS  7  9E-005 

(5382  MS) 


1  1X1=3  81 [X2=0] 1X3=2] [X4=0  1] [X7=0. t][X8=l  21  6  2  0E*005 

!X9=0. 11 [111=11 [X13=01 [X14=2! [X 15=23  [X16=01 

[Xl7=0i [X 18=01 [X19=ll tX21=1.31 [X22=0. t! [X24=ll 
[X28=0! [X27=01 [X28=0 , 3] [X29=4l [X30=01 [X31=0i 
1X32=01 1X33=01 1X34=01 1X35=01 
EVENTS  COVERED  1.2.3.4.5.8.7.8.9.10.28.29 

2  (XI =3  81 [X2=01 1X3=0] 1X4=1  211X7=2.311X8=1]  19  1528 

1X9=0.11 [X11=U 1X12= 1 3 1X13=0] 1X14=21 1X15=21 

1X18=0] 1X17=0] 1X18=0] 1X19=1] [X21=0! 1X22=3] 

1X23=0] 1X24=0] 1X25=0] 1X28=2] [X27=t] 1X28=0] 

1X29=4] 1X30=0! 1X31=0] 1X32=0] [X33=0] 1X34=0] 

1X35=0] 

EVENTS  COVERED  11.12,13.14.15.18.17.18.19.20 

3  1X1=0  3] 1X2=1] [X3=l  211X4=0  1] 1X7=1. 3]  31  39£‘OOS 

[X8=l  .2) 1X9=0. 1] 1X11=1] [X13=0] 1X14=2] 1X15=2] 

[X18=0] 1X17=0] 1X18=0] 1X19=1] 1X21=1,2] 1X22=1.2] 

1X23=0] 1X24=0. 1] 1X28=0] 1X27=0] 1X28=3] [X29=4] 

[X30=0] 1X31=0] 1X32=0] 1X33=0] [X34=0] 1X35=0,1] 

EVENTS  COVERED  21.22.23.24.25.27.28.30.31.32.33.34.35.38.37. 
38.39.40.41,42.43.44.45.46,47 

TOTALS  5  9E*00S 

(5837  MS) 


The  fifth  iteration  The 
•par stness  eeore  improves  a 
little 


1  1X1=3 
[X9=0. 1 
1X17=0] 
1X28=0] 
1X32=0] 
EVENTS 

2  [Xl=3 
[X9=0. 1 
1X18=0] 
1X23=0] 
1X29=4] 
1X35=0] 
EVENTS 

3  (X1=0 
1X8=1  . 
1X18=0] 
1X23=0] 
1X30=0] 
C.-ENTS 

TOTALS 
(4514  MS) 


8] 1X2=0! 1X3=2] 1X4=0  . 1] (X7=0, 1] [X8=l  2]  8  2  0E*005 

l  1X11  =  1] 1X13=0! 1X14=2] 1X15=2] 1X16=0] 

1X18=0] CX l 9= 1 ] 1X21=1.3] 1X22=0.1) [X24=l] 

1X27=0] 1X28=0.3] 1X29=4] 1X30=0] [X31=0] 

1X33=0] 1X34=0] 1X35=0] 

COVERED  1.2.3.4.5.6.7.8.9,10.26.29 

8] 1X2=0] 1X3=0] [X4=l .  2] 1X7=2. 3] 1X8=1]  19  1528 

] [XI 1=1] [X12=l] 1X13=0] 1X14=2] 1X15=2) 

1X17=0] 1X18=0] 1X19=1] 1X21=0! [X22=3] 

1X24=0] 1X25=0] 1X26=2] 1X27=1] [X28=0] 

1X30=0] 1X31=0] 1X32=0] [X33=0] 1X34=0) 

COVERED;  11 . 12. 13 . 14 . 15. 18. 17. 18, 19. 20 

3] [X2=l] [X3=l  2] [X4=0  1] 1X7=1.31  38  3  9E*005 

2] 1X9=0. 1] 1X11=1] [XI3=0I 1X14=2) 1X15=2] 

1X17=0] 1X18=0] 1X19=1] 1X21=1.2] 1X22=1.2] 

1X24=0.1] 1X26=0! 1X27=0] 1X28=31 1X29=4] 

1X31=0] [X32=0] [X33=0] 1X34=0] [X35=0.1] 

COVERED  21.22.23.24.25.27,28.30.31.32.33.34.35.36.37, 
38,39,40,41 ,42,43. *4,45,48,47 

5  9E+005 


The  sixth  iteration  Mo  in- 
provement  in  sparseness 
This  iteration  counts  against 
the  PROBE  count 


(Xl=3  .6] 1X2=0] 1X3=2] 1X4=0  1] 1X7=0, l] [X8=l  2] 

1X9=0. 1] 1X11=1] 1X13=0] 1X14=2] 1X15=2] 1X16=0) 
1X17=0] 1X18=0] 1X19=1] 1X21=1.3] 1X22=0,1] 1X24=1] 
1X28=0] 1X27=0] 1X28=0,3] 1X29=4] 1X30=0) 1X31=0] 
1X32=0]  1X33=0]  1X34  =  0]  1X35=0) 

EVENTS  COVERED  1.2,3.4.5.6.7.8.9,10,28,29 
1X1  =  3  6)  1X2=0]  1X3=0]  1X4  =  1  2] 1X7  =  2 . 3] 1X8= 1 ] 

1X9=0. t] 1X11=1] 1X12=1! 1X13=0] 1X14=2] 1X15=2] 
1X16=0] 1X17=0] 1X18=0] 1X19=1] 1X21=0] 1X22=3] 

1X23  =  0]  1X24=0!  1X25  =  0;  X26=2]  1X27  =  1]  ]X28  =  0] 
1X29=4]  1X30  =  0!  1X31=0]  1X32=0]  1X33  =  0]  ]X34  =  0] 


The  seventh  iteration  The 
sparseness  does  not  improve 
This  exhausts  the  PROBE 
count 


46 


3  9E-005 


;x35=o: 

EVENTS  COVERED  11. 12. 13. 14. IS. IS. 17. 18. 19.20 

7  3  ;xi=o  3: ;x2=i:  ;x3=i  2: 1x4=0  i::x7-i.3j 

:xs=i  2:  :x9=o.i:  :xu=i:  1x13=01  1x14=2]  1x15=2! 

;xie=o; :xi7=o: :xis=oi 1x19=1; 1x21=1 .2: 1x22=1.2: 

1X23=0] 1X24=0, 11 [X26=0! 1X27=0] 1X28=3] 1X29=4] 

1X30=0!  1X31=0]  1X32=0!  1X33=0) [X34=0] (X35=0.l! 

EVENTS  COVERED  21 . 22. 23. 24 . 25 . 27 , 28 , 30 . 31 , 32 . 33 . 34 . 35 . 30  37 , 

38, 39, 40. 4 1.42, 43, 44. 45. 46. 47 

7  TOTALS  5  9E-005 

(4826  MS) 


THE  2  BEST  CLUSTERINGS  FOLLOW  <34746  MSI  The  two  best  e/uilfriny«  with 

arc  reported 

ITER  CLASS*  VL-RULE  SEED  --COSTS--- 

SPAR 

5  1  1X1  =  3  8] 1X2=0] 1X3=2! 1X4=0  I] 1X7=0. 1] 1X8=1  2)  8  2  OE-005 

[x9=o . i; ixi 1=1 ; ;xi3=o: 1x14=21 1x15=21 cxie=oi 

1X17=0! 1X18=01 1X19=11 1X21=1.31 1X22=0,11 [X24=H 
1X26=01 1X27=0! 1X28=0,31 1X29=4] 1X30=01 1X31=01 
1X32=0] 1X33=0] 1X34=0] (X35=01 
EVENTS  COVERED  1.2,3.4.5.6.7.8.9.10.26.29 
5  2  1X1=3  6] [X2=0] 1X3=0] 1X4=1  211X7=2.311X8=1!  19  1528 

1X9=0.11 1X11=11 1X12=11 1X13=01 1X14=21 1X15=2] 

1X16=01 1X17=0] 1X18=01 1X19=11 1X21=0] 1X22=3] 

1X23=01 1X24=0] 1X25=01 [X26=21 [X27=l! 1X28=0] 

1X29=4] 1X30=0] 1X31=0! [X32=0] 1X33=0] 1X34=0] 

1X35=0] 

EVENTS  COVERED  11.12.13.14.15.16.17.18.19.20 
5  3  1X1=0  311X2=111X3=1  211X4=0  111X7=1.3]  31  39E-005 

1X8=1  2] 1X9=0.11 1X11=1] 1X13=0! 1X14=2; 1X15=2! 

1X18=0!  1X17=0!  1X18=0] 1X19=1) 1X21  =  1.2]  1X22=1,2] 

1X23=0! 1X24=0.1] (X26=0! 1X27=0] 1X28-3! 1X29=4) 

1X30=0] 1X31=0] 1X32=0] 1X33=0] 1X34=0] [X35=0. 1) 

EVENTS  COVERED  21.22.23.24.25.27.28.30.31.32.33.34.35.36.37. 

38.39.40.41.42.43.44.45.46.47 

5  TOTALS  5  9E-005 

4  1  1X3=2! 1X4=0  l] [X7=0. 1] 1X8=1  2] 1X9=0. 1 ] [XI 1 = 1 ]  2.  69E*005 

1X13=0] 1X14=2] [X15=2! 1X16=0] 1X17=0] 1X18=0] 

1X19=1] 1X21=1.3] 1X22=0.1] 1X24=1] [X28=0] 1X27=0] 

1X28=0.3] 1X29=4] [X30=0] 1X31=0] 1X32=0] [X33=0] 

1X34=0] 1X35=0] 

EVENTS  COVERED  1.2.3.4.5,6,7.0.9.10.21,22,23.24.25,28.28.29.30 
4  2  1X1=3  8]  [X2=0]  1X3=0]  1X4  =  1  2] 1X7  =  2 , 3]  1X8  =  1 ]  19  1526 

1X9=0. 1] 1X11=1] 1X12=1] 1X13=0] 1X14=2] 1X15=2] 

1X16=0] 1X17=0] 1X18=0] 1X19=1] [X21=0! 1X22=3] 

1X23=0] 1X24=0] 1X25=0) 1X26=2] 1X27=1] [X28=0] 

1X29=4] 1X30=0] 1X31=0) [X32=0! 1X33=0] [X34=0] 

1X35=0] 

EVENTS  COVERED  11.12.13,14,15,18.17,18,19.20 
4  3  1X1=0  3] 1X2=1] 1X3=1  2] 1X4=0  li[X7=I.3l  3!  9  8E*004 

1X8=1  2! 1X9=0. l! 1X11=1) 1X13=0] 1X14=2] [X15=2] 

1X18=0) 1X17=0] 1X18=0] 1X19=1] 1X21=1,2) 1X22=1.2] 

1X23=0) 1X24=0.1] [X25=0] 1X26=0] 1X27=0] ]X28=3] 

1X29=4) 1X30=0] 1X31=0) [X32=0] [X33=0] 1X34=0] 

1X35=11 

EVENTS  COVERED  27,31.32.33.34.35.36.37.38.39.40.41.42.43.44. 

45.46.47 

4  TOTALS  7  9E-005 

(42  STARS  BUILT) 


FOR  THE  BEST  SOLUTION  ABOVE.  S=  l  6E*007 


The  value  o/  the  etpremon 
tparienc ee  *  k  * 


EXPERIMENT  1  K=4,  CRITERION=F 


The  whole  proceti  u  repeated 
for  k=4 


INTERMEDIATE  RESULTS 

ITER,  CLASS*  VL-RULE  SEED  --COSTS - 

SPAR 

1  l  3X3=2]  3X4=0  1] [X7=0. 1] 3X8=1  2! 3X9=0] ;xi 1=1 j  1  3  4E-005 

3X13=0]  3X14=2]  [X15=2j  [X18=0!  (X17=0i  3X18=0) 

[X19=l! [X2l=l .3] [X22=l] [X24=l] 3X28=0! 3X27=0] 

3X28=0,3]  [X29=4] 3X30=0] 1X31=0] (X32=0] ;X33=0] 

[X34=0] 3X35=0. 1] 

EVENTS  COVERED  1,8.7,10,22.23.28,27.28.29 
1  2  1X1=4  8] :X2=0] 3X4  =  1  2][X8=1  3)[X7=0.l.3j  2  1  9E-00S 

:X8=U  1X9=1  j  [Xll  =  l!  3X12=1]  l XI 3=0 3  [X14=2]  3X15=2! 

3X16=0] 3X17=0]  tX18=0] [X19=l] :x21=0. 3] [X22=0, 1.3] 

;X24=0. l! 3X25=0] 3X26=0 .2] 3X28=0] [X29=4] 

[X30=0] 3X31=0] 3X32=0] 3X33=0] [X34=0! 3X35=0) 


EVENTS  COVERED  2.5.9,11.12,15.17.19 
1  3  3X1=0  3] [X3=l  213X4=0  1] [X7=0, t .3! 3X8=1  2!  3  53E-008 

3X9=1] 3X11=1]  3X13=0] 3X14=2] 3X15=2! 3X18=0] 

3X17=0!  3X18=0]  3X19=1] 3X21=1,2.3] 3X22=0.1.2! 

3X24=0. 1] 3X26=0] 3X27=0) 3X28=0,3] 3X29=4] 3X30=0! 

3X31=0]  3X32=0] 3X33=0] [X34=0] 3X35=0.1] 

EVENTS  COVERED  3.8.21.24.25.30.31.34.35.37.38.41.43.44.47 
1  4  3X7=1. 2]  3X8=1  2] 3X9=0] 3X11=1] 3X12=1] 3X13=0]  4  1  4E-007 

3X14=2]  3X15=2] [X16=0] [X17=0] 3X18=0] 3X19=1] 

3X21=0, 1.3] 3X22=0.2.3] 3X24=0.1] 3X25=0]  3X26=0.2] 

3X28=0.3] 3X29=4] [X30=0! 3X31=0] 3X32=0] 3X33=0] 

3X34=0]  3X35=0.1] 


EVENTS  COVERED  4.13,14.16.18.20.32,33.36,39.40.42.45.46 
1  EXCEPTIONAL  EVENTS  22.27 

1  TOTALS  2  OE*007 

(7267  MS) 


2  1  3X1=0  4] [X3=2] 3X4=0  1] 3X7=1] 3X8=1  2] 3X9=0, 1]  23  1  2E>005 

3X11=1]  3X13=0] 3X14=2]  3X15=2]  3X16=01 3X17=0] 

3X18=0]  3X19=1] 3X21=1] 3X22=1.2] 3X23=0] 3X24=0.1] 

3X26=0]  3X27=0] 3X28=3] 3X29=4] (X30=0] 3X31=0] 

3X32=01 3X33=0] 3X34=0] 3X35=0,1] 

EVENTS  COVERED  21.22.23.24.25.26.27.28.29.30.32.33.36.40,45.46 
2  2  3X1=3  6] [X2=0]  3X3=0] 3X4=1  2] 3X7=2. 3] 3X8= 1 ]  19  1526 

3X9=0. 1;  3X11=1] 3X12= 1 ]  3X13=0]  3X14=2!  3X15=2] 

3X16=0] 3X17=0] [X18=0] 3X19=1] 3X21=0] 3X22=3] 

3X23=0]  3X24=0] 3X25=0] 3X26=2] 3X27=1]  3X28=0] 

3X29=4] 3X30=0] 3X31=0] ;X32=0] 3X33=0] 3X34=0] 

3X35=0] 

EVENTS  COVERED  11.12.13.14.15.18,17.18.19,20 
2  3  3X1=1  6]  3X3=2]  3X4=0  1 ] (X7=0. 1 . 3] 3X8= l  2]  31  1  3E-008 

3X9=0.13  3X11  =  1] 3X12=1] 3X13=0]  3X14  =  2! 3X15  =  2] 

3X16=0]  3X17=0]  3X18=0]  3X19=1] [X21=2.3] 3X22=0, 1 . 

2] 3X24=0. 1] 3X25=01 3X26=0] 3X27=0] 3X28=0,3] 

3X29=4] 3X30=0]  3X31=0] [X32=0] 3X33=0! 3X34=0] 

3X35=0.1] 

EVENTS  COVERED  1.2,3,4.5.6.7.8,9.10.31.34.35.37.38.43,44 

39  4604 


1  5E=006 


23  1  0E-004 


3X31=0]  3X32=0!  3X33=0!  3X34=0] 'X35=0. 1 ! 

EVENTS  COVERED  21.22.23.24.25.26.27.28.29.30 


2  4  3X1=0  3]  3X2=1] 3X3=1] 1X4=0  1] 3X6=1  3]  3X7=1] 

3X8=1  2! [X9=0.1] [XI 1 = 1 ] [X 12= 1 ! 3X13=0!  3X14=2! 

3X15=2!  3X16=0] 3X17=0]  3X18=0] 3X19=1] 3X21=1.2] 
3X22=2]  3X23=0!  3X24=0, l] 'X25=0] 3X26=0] 3X27=0] 
3X28=3]  3X29=4] 3X30=0! [X3t=0] 3X32=0] 3X33=0] 
3X34=0]  3X35=1] 

EVENTS  COVERED  39,41.42.47 

2  TOTALS 
(10748  MS) 

3  1  3X1=0  4]  3X3=2] 3X4=0] [X7=l] 3X8=1  213X9=0.1] 

3X10=1  2]  3X11=1! 3X13=0! 3X14=2!  rX15=2]  3X16=0] 

3X17=0]  3X18=0]  3X19=1] 3X21=1! 3X22=1]  3X23=0] 
3X24=1! 'X26=0i  3X27=0!  3X28=3] 3X29=4]  X30=0] 


The  first  iteration 


These  events  could  not  he 
covered  and  still  maintain  dis¬ 
joint  completes 

The  second  iteration  The 
sparseness  score  improves 


The  third  iteration  The 
sparseness  score  improves 
again 


2  :xi=3  e.  :x2=o;  :x3=o; :x4=i  2j  ;x7=2.3! 1x8=1:  19  1526 

3X9=0.  1]  :xi  1  =  1:  3X12=1,  3X13=0]  3X14=2]  3X15=2! 

:xi8=o:  :xi7=o;  :xi8=o;  3x19=1: 3x21=01 3x22=3] 

3x23=01 3x24=0; :x2s =0: 3x26=2] 3x27=1: 3x28=01 

3X29=4!  3X30=0] 3X31=0!  3X32=0! 3X33=0] 3X34=0) 

3X35=0] 

EVENTS  COVERED  11.12.13.14.15,18.17,18.19.20 

3  3X1=3  8]  [X2=0][X3=2]  tX4=l]  3X6=1  3] 3X7=0. 1)  8  2294 

3X8=1  2] 3X9=0, 1]  ;xtl  =  ll 3X12=1] [X13=0]  3X14=2] 

3X15=2]  3X18=01 3X17=01 [X18=0l 3X19=11 3X21=31 
3X22=0,11 3X23=11  3X24=1! 3X25=01 3X28=01 3X27=0] 

3X28=0!  3X29=4! [X30=0] (X31=0] 3X32=0! 3X33=0) 

3X34=0] 3X35=01 

EVENTS  COVERED  1.2.3,4.5,8,7.8,9.10 

4  3X1=0  3]  3X2=1! 3X3=1  2! 3X4=0  1 1  3X7=1 .3]  47  25E-004 

3X8=1  2!  3X9=0,13  3X11=1] 3X12=1!  3X13=0] 1X14=2] 

3X15=2!  3X16=0)  3X17 =0! 3X18=0] (X19=l! 3X21  =  1.21 
3X22=2!  3X23=0!  3X24=0.1! 3X25=0] 3X28=0! [X27=0] 

3X28=3] 3X29=4]  3X30=Oi 3X31=0] [X32=0l 1X33=0) 

3X34=0] 1X35=1) 

EVENTS  COVERED  31.32.33.34,35,38.37.38.39.40,41.42.43,44,45.46.47 
TOTALS  3  9E+004 

(8878  MS) 

1  'X1=0  4] tX3=2] 3X4=0] 3X7=1] 3X8=1  2] [X9=0. 1]  22  10E-004 

3X10=1  21 3X11=1) 3X13=0] 3X14=21 3X15=2] 3X16=0] 

3X17=0] [X18=0] [X19=l! (X21=l ] 3X22=1] 3X23=0] 

3X24=1] [X28=0]  3X27=0]  3X28=3] 3X29=4] 3X30=0] 

3X31=03 3X32=0] 3X33=0] 3X34=0] 3X35=0.1] 

EVENTS  COVERED  21.22.23.24.25.28.27.28.29,30 

2  3X1=3  8]  3X2=0] 3X3=0] [X4=l  213X7=2.3)3X8=1]  19  1528 

3X9=0. 1] 3X11=1] 3X12=1] 3X13=0]  3X14=2! 3X15=2] 

3X18=0] [X17=0]  3X18=0] 3X19=1] 3X21=01 3X22=3] 

3X23=0!  3X24=0] 3X25=0] 3X28=2] [X27=l] 3X28=0] 

3X29=4! 3X30=0] 3X31=0] 3X32=0] 3X33=0] 3X34=0] 

3X35=0] 

EVENTS  COVERED  1 1 . 12 . 13 . 14 . 15 . 16 . 17 . 18, 1 9. 20 

3  3X1=3  .6] 3X2=0] 3X3=2] [X4=l] 3X8=1  3! [X7=0, 1]  2  2294 

3X8=1  2] 3X9=0. 1]  3X11=1] [X12=l] 3X13=0] 3X14=2] 

3X15=2] 3X18=0]  3X17=0] 3X18=0] 3X19=1] 3X21=3] 

3X22=0.1] 3X23=1] 3X24=1] 3X25=0] 3X26=0] 3X27=0) 

3X28=0] 3X29=4] 3X30=0] 3X31=0] [X32=0! 3X33=0] 

3X34=0] 3X35=0] 

EVENTS  COVERED:  1,2.3.4.5,8.7,8.9.10 

4  [X1=0  3] 3X2=1] 3X3=1  213X4=0  1]!X7=!.3]  31  25E*004 

3X8=1  2] 3X9=0. t]  3X11=1] 3X12=1] 3X13=0] 3X14=2] 

3X15=2] 3X16=0]  3X17=0] 3X18=0] 3X19=1] 3X21=1.2) 

3X22=2] 3X23=0!  3X24=0, 1] 3X25=0] 3X26=0] [X27=0] 

3X28=31  3X29=4]  3X30=0]  3X31=0] 3X32=0] (X33=0) 

3X34=0] 3X35=1] 

EVENTS  COVERED  31,32,33,34  35.36,37.38.39.40,41.42,43,44,45.46,47 
TOTALS  3  9E-004 

(8041  MS) 

1  3X1=0  4]  3X3=2] 3X4=0] [X7=l] 3X8=1  213X9=0.1]  21  1  0E-004 

3X10=1  2! 3X11=1] 3X13=0] 3X14=2] 3X15=2] 3X16=0] 

3X17=0] 3X18=0]  3X19=1] 3X21=1] 3X22=1] 3X23=0] 

3X24=1] [X26=0] [X27=0]  3X28=3] 3X29=4] 3X30=01 
3X31=0] 3X32=0]  3X33=0]  3X34=0] 3X35=0,1] 

EVENTS  COVERED  21,22,23.24,25,28.27,28,29.30 

2  3X1  =  3  6]  3X2=0] 3X3=0]  3X4=1  2]  3X7=2 , 3)  3X8=  1  ]  18  1528 

3X9=0. 1] 3X11=1] 3X12=1] 3X13=0]  3X14=2] 3X15=2] 

3X18=0]  3X17=0]  3X18=0]  3X19=1] 3X21=0] 3X22=3] 

!X23=o:  3X24=0!  3X25=0]  3X26=2] 3X27=t! !X28=0] 

3X29=4!  3X30=0!  3X31=0]  3X32=0! 3X33=0! !X34=0i 
!X35=o; 

EVENTS  COVERED  1 1 . 12. 13. 14. IS. 18. 17. |8. 19.20 

3  Xl=3  6!  !X2=0]  3X3=2]  !X4=l!  !X6=1  3!  3X7=0. 1]  10  2294 

3X8=1  2!  3X9=0, l!  3X11=1] 3X12=1!  3X13=0! 3X14=2] 


The  fourth  iteration  The 
epaneneet  doer  not  improve 


The  fifth  iteration  The 
tponenen  doee  not  improve 
Thu  ezhautte  the  PROBE 
count 


,  rV  •  .  :  y  f  r *  r'*r ,  r ,-v  .V,  •> >  . ,  r  .  ■  «  •  «>  .  -  .  ■  ,r. .  •  .V  .  «, •  »>  ,  .i kVIV  ,  '  '  ■ 
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C X 15=2]  [X16=0] t X 17=0]  1X18=0]  1X19=1! 1X21=3] 

1X22=0,1]  1X23=  1 1  1X24=1]  1X25=0]  ;X28=0]  1X27=0] 

;X28=0] [X29=4] 1X30=0]  CX3 1=0) 1X32=0] 1X33=0] 

1X34=0] 1X35=0] 

EVENTS  COVERED  1,2.3.4.5,8,7,8,9,10 
4  1X1  =  0  3]  1X2=1]  1X3=1  211X4=0  111X7  =  1.3!  48  2  5E-004 

[X8= 1  2] [X9=0, 1] tX 11=1 ] [X12=l] 1X13=0] 1X14=2] 

[X15=2) 1X16=0! f X 1 7=0) [X18=0] 1X19=1] 1X21=1.2] 

[X22=2] [X23=0] [X24=0, 1] [X25=0] 1X26=0] 1X27=0] 

[X28=3] [X29=4] 1X30=0] 1X31=0] 1X32=0] [X33=0i 
1X34=0] 1X35=1] 

EVENTS  COVERED  31,32,33,34,35.38,37,38.39,40.41.42,43,44.45,48,47 
TOTALS  3  9E+004 

(9248  MS) 


THE  2  BEST  CLUSTERINGS  FOLLOW 


(44984  MS) 


ITER/CLASS*  VL-RULE 


1  (X1=0 
[X10=l 
[X 17 =0  ] 
1X24=1] 
[X31=0] 
EVENTS 

2  [Xl=3 . 
[X9=0, 1 
C  X 1 6=0 ] 
[X23=0] 
[X29=4] 
1X35=0] 
EVENTS 

3  ;xi=3 
1X8=1 
[X15=2] 
1X22=0 . 
[X28=0l 
;X34=0) 
EVENTS 

4  [X1=0 
[X8=  l 
Cx 15=2) 
1X22=2] 
[X28=31 
[X34=0l 
EVENTS 

TOTALS 


4! CX3=2]  CX4=0) 
2] [Xll  =  l]  C X 1 3 
1X18=0] !X19=l! 
[X28=0] 1X27=0] 
1X32=0] 1X33=0! 
COVERED  21.22 
8] [X2=0i 1X3=0] 
]  1X11  =  1]  1X12=1 
[X17=0] 1X18=0] 
[X24=0] [X25=0] 
1X30=0] 1X31=0] 

COVERED  11,12 
8]  CX2=0) 1X3=2] 

2]  [X9=0. 1]  [XU 
CX18=0] [X17=0] 

1)  [X23= 1 ] tX24= 
1X29=4] [X30=0] 
1X35=0] 

COVERED  1,2.3 

3)  [X2= 1 ] 1X3=1 

2]  (X9=0. 1]  [XU 

;xia=o]  C X 1 7 =0 ] 

[X23=0] :X24=0, 
1X29=4] [X30=0] 
CX35=  1  ] 

COVERED  31,32 


1X7=111X8=1  2! 1X9=0. 1] 

=0) [X14=2l [ X 1 5=2 ] [X16=0] 
[X21=l! 1X22= 1 ) [X23=0] 
[X28=3] 1X29=4] [X30=0] 
1X34=0] [X35=0, 1] 

1.23,24. 25, 28, 27. 28. 29. 30 
(X4=l  2] !X7=2.3] [X8=l] 

1 [ X 1 3=0 ]  C  X 1 4 =2  3  C  X 1 5=21 
[X 19= 1 J !X21=0] [X22=3] 
[X28=2] (X27=l) [X28=0] 
1X32=0] [X33=0! 1X34=0] 

, 13, 14.15. 18.17. 18. 19.20 
[X4=1)(X8=1  3) CX7=0, 1 ) 

=  1]  CX 1 2= 1 } [ X 13=0 3 1X14=2) 
(XI 8=0 J  [X19=l! [X21=3] 
l! [X25=0] (X28=0! [X27=0J 
( X3 l =0 ] 1X32=0] [X33=0] 

,4,5,8.7,8,9.10 
2] (X4=0  l! 1X7= l . 3] 

=  1] ( X 1 2= 1 3  [X 13=0] [ X 1 4 =2 1 
[X18=0] 1X19=1’ 1X21=1 ,23 
1] iX25=0] 1X26=0] 1X27=0] 
1X31=0’ [X32=0] SX33=0) 


SEED  --COSTS— 
SPAR 

23  1  0E*004 


The  two  beet  eluetennye  for 
k~4  ore  reported  Thu  eola¬ 
tion  matcher  human 
claeeifieatione  of  dieeaeed  eoy- 
beane  It  forme  the  top  level  of 
the  ctaeeification  hierarchy 
emce  it  le  the  beet  eolation  ae 
meatier ed  by  Aturulic  S 


47  2  5E‘004 


.33,34,35,38.37,38,39.40,41,42,43,44.45,48.47 

3  9E-*-004 


[Xl=0  4] 1X3=2! 1X4=0 

(XI 1  =  1 ]  (XI 3=0 i (X 1 4=2 3  [ 
[X18=0]  :X19=1] ( X2 1  =  1)  ( 
1X26=0] ]X27=0] 1X28=3] 1 
1X32=0]  ;X33=0]  1X34=0]  [ 
EVENTS  COVERED  21.22. 
[XI =3  8] 1X2=0] [X3=0] : 

[X9=0, 1] (XI  1  =  1)  (X 1 2= 1 ] 
[X18=0] ;xi7=0] (X 18=03  ( 
[X23=0i :X24=0] !X25=0]  C 
;X29=4]  :X30=0)  ;X31=0]  [: 
:x35=o; 

EVENTS  COVERED  11,12. 
;xi=l  8) [X3=2! [X4=0 
:x9=o,  i;  :xu=i;  1x12=11 
(X  16=03  1X17=0]  1X18=01  [: 
21  1X24  =  0,1] 1X25=0]  1X28 
X29=4] 1X30=0] 1X31=0] 1 
1X35=0,1] 


1] [X7=l 3  [X8=l  .2] [X9=0 , 1]  23  12E-005 

X15=2] (X 16=0! [X17=0] 

X22= 1 , 2] 1X23=0] 1X24=0, 1] 

X29=4J  1X30=0] ( X3 1=0) 

X35=0, 1) 

23,24,25.28,27.28,29.30.32,33,38,40,45,46 
X4= 1  2]  1X7=2, 3]  1X8=1]  19  1528 

1X13  =  0]  1X14=2! ( X 1 5=2  3 
X 19= 1 ] 1X21=0] 1X22=3] 

X26=2] 1X27=1] 1X28=0] 

X32=0] 1X33=0] ( X34  =  0  3 


13.14,15,  16,17,18,  19,20 
l! 1X7=0. 1,3] 1X8=1  2] 

1X13=0! 1X14=2] 1X15=2! 
X19=l] 1X21=2,3! 1X22=0,1. 
=0] 1X27=0] 1X28=0,3] 
X32=0] 1X33=0! 1X34=0] 


31  1  3E*006 
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R 


EVENTS  COVERED  1,2.3,4,5,8,7.8.9.10.31,34,35.37.38.43.44 
2  4  [X1=0  3]  1X2=11  :X3=  1  ]  [X4=0  11  1  X6=  1  3] [X7=ll  39  4604 

;xs=  1  2!  ;x9=o,  11  :xi  1=11  1x12=11  1x13=01  1x14=21 

1X15=2] 1X18=0] 1X17=0] 1X18=0] 1X19=1] 1X21=1. 21 
1X22=21 1X23=0] [X24=0. ll 1X25=0] 1X28=0! 1X27=0) 

1X28=3! 1X29=4) 1X30=0) [X31=0l 1X32=01 [X33=0] 

1X34=0) 1X35=1) 

EVENTS  COVERED  39,41.42.47 

2  TOTALS  1  5E-006 

(50  STARS  BUILT) 

FOR  THE  BEST  SOLUTION  ABOVE,  S=  2  5E»006 


WITH  BETA=  3  00  THE  BEST  CLUSTERING  AT  THIS  LEVEL  IS  FOR  K=4 


TS 


V". 

r* 


•V 


a 


i  s, 


$  A 


V 


BEGINNING  CLASSIFICATION  BELOV  HIERARCHY  PATH  1-0 


EXPERIMENT  1:  K=2.  CRITERION=F 


THE  1  BEST  CLUSTERINGS  FOLLOV 


(2242  MS) 


ITER/CLASS*  VL-RULE 


1 


1 


[X1=0] 1X2= 1 ! 1X3=21 1X4 
1X8=1  211X9=0.111X10 

1X13=0] 1X14=21 1X15=21 
1X19=1] 1X20=01 1X21=1] 
1X26=0] 1X27=01 [X28=31 
1X32=0] [X33=0] 1X34=01 
EVENTS  COVERED  21.24 
2  1X1=2  411X3=211X4=01 

1X10=1  2]  1X11  =  1] 1X13 

1X17=01 1X18=01 1X19=1] 
1X24= 1 i 1X26=0] 1X27=0] 
[X31 =0] [X32=0l 1X33=0] 
EVENTS  COVERED:  22.23 
TOTALS 


=011X5=011X8=0  21 1X7= 1 ] 

=1  2) 1X11=1] 1X12=0] 

1X16=01 1X17=0] 1X18=0] 
1X22= 1 1  1X23=0] [X24  =  l] 
1X29=4) [X30=0] 1X31=0] 
1X35=0. 1] 

.25,27.30 

1X7=111X8=1.  211X9=0] 

=0] 1X14=2] (X15=2! 1X18=0] 
1X21=1] 1X22=1] [X23=0] 
1X28=3] [X29=4] 1X30=0] 
1X34=0] 1X35=0] 

.26.28.29 


(12  STARS  BUILT) 

FOR  THE  BEST  SOLUTION  ABOVE,  S=  1  3E-004 


EXPERIMENT  1  K=3,  CRITERION=F 


THE  1  BEST  CLUSTERINGS  FOLLOV 


(4697  MS) 


ITER.  CLASS*  VL-RULE 


SEED  —  COSTS— - 
SPAR 

21  91 


22 


1531 


1822 


1X1=01 1X2=1] 1X3=2] 1X4=0] 1X5=01 1X6=0  21 1X7=1] 

1X8=1  211X9=0.111X10=1  211X11=111X12=0] 

1X13=01 1X14=2] 1X15=21 1X16=01 1X17=0] 1X18=0! 
1X19=1]  1X20  =  0]  1X21  =  1]  1X22=11  1X23=01  1X24=1] 
1X26=0] 1X27=0] 1X28=31 1X29=4] 1X30=0] 1X31=0] 
1X32=01 1X33=0] 1X34=0] 1X35=0. 1 1 
EVENTS  COVERED  21,24.25.27.30 
1X1=2]  1X2=1]  1X3=2!  1X4=0]  1X5  =  0] 1X6  =  2  3]  1X7  =  1’ 

1X8=1  2] rX9=0l 1X10=1  2] 1X11=11 1X12=0] 1X13=0] 

1X14=2]  1X15  =  2]  1X18=0]  1X17=01  1X18  =  0]  1X19=1! 
1X20=0]  1X21  =  1]  1X22=1]  1X23=0]  1X24=1]  1X28=0] 


SEED  --COSTS - 

SPAR 

21  91 


13 


The  value  of  the  expression 
spartenets  X  i**3  t#  given 

The  lowest  value  of  S  denoting 
the  best  Jit  was  obtained  with 

The  top  level  of  the  hierarchy 
hat  four  classes  The  clutter 
algorithm  it  applied  to  each 
clatt  individually  to  generate 
tecond-levcl  clattet 

For  clatt  1,  cluttenngt  are 
generated  for  k  varying  from  S 
to  4  The  detailed  output  of 
intermediate  and  alternative 
reeultt  hat  been  tuppretted  in 
(hit  part  of  the  lilting  to  con - 
serve  space 


Thu  solution  it  best  according 
to  heuristic  S  for  the  second 
level  classes  which  split  clatt 
l 


1X27=0] 1X28=3] 1X29=4] 1X30=0] 1X31=0] 1X32=0] 
1X33=0] [X34=0] 1X35=0] 

EVENTS  COVERED  22.23.28 

2  3  1X1  =  3  4] [X2=0] 1X3=2] 1X4=0] 1X5=1] [X7=l> 1X8=2] 

1X9=0]  [X10=  1  2]  ;Xll=r,  1X13=0]  [X14=2]  1X15=2] 

1X16=0]  1X17=0] [X18=Oi  1X19=1] r  X20= 1 ]  [X21  =  1 ] 
1X22=1]  1X23=0]  1X24=1]  [X25=t]  1X28=0]  1X27=0] 
1X28=3] 1X29=4] (X30=0] 1X31=0) 1X32=0! 1X33=0] 
1X34=0] 1X35=0] 

EVENTS  COVERED  26.29 
2  TOTALS 

(24  STARS  BUILT) 

FOR  THE  BEST  SOLUTION  ABOVE,  S  =  3  8E-003 


EXPERIMENT  1  K  =  4.  CRITERION=F 


THE  1  BEST  CLUSTERINGS  FOLLOW 


ITER,  CLASS*  VL-RULE 


(12285  MS) 


5  1  iXl=0] 1X2=1] 1X3=2] 1X4=0] [X5=0] (X8=0  211X7=1) 

1X8=1  21  [X9=l]  [X10=t  21  1X11=1]  1X12=0)  [X13=0] 

CX 1 4=2) [X15=2l 1X16=0] 1X17=0] [X18=01 [X19=l] 
1X20=01  1X21=1]  [X22=l]  1X23=0]  (X24=ll  [X26=0] 
1X27=0] 1X28=3] [X29=4J 1X30=0] 1X31=0] [X32=0] 
1X33=0] 1X34=0] 1X35=0) 

EVENTS  COVERED  21.24.25.30 
5  2  1X1=2  .4] 1X3=2] 1X4=0] [X6=0  2] 1X7=1] 1X8=1  2) 

1X9=0]  1X10=2]  1X11  =  1] [X13=0]  1X14=2] [X15=2] 
1X16=0] 1X17=0] 1X18=0] 1X19=1] 1X21=1] 1X22=1] 
1X23=0] 1X24=1] 1X25=1] 1X26=0] [X27=0] 1X28=3] 
1X29=4] [X30=0] 1X31=0] 1X32=0] 1X33=0] (X34=0) 
1X35=0] 

EVENTS  COVERED  22.29 

5  3  1X1=2  3] 1X3=2! [X4=0] 1X6=3] 1X7=1] 1X8=2) 1X9=0] 

1X10=1 . .2] 1X11=1] 1X12=0] 1X13=0] 1X14=23 1X15=2] 
1X16=0] 1X17=0] 1X18=0] 1X19=1] 1X21=1] 1X22=1] 
1X23=0] 1X24=1] 1X26=0] [X27=0] [X28=3] 1X29=4] 
1X30=0] 1X31=0] 1X32=0] 1X33=0] 1X34=0] [X35=0] 
EVENTS  COVERED  23.28.28 

5  4  1X1=0] [X2=t] 1X3=2] 1X4=0] 1X5=0] 1X8=0] 1X7=1] 

1X8=1] 1X9=0] 1X10=1] 1X11=1] 1X12=0] 1X13=0] 1X14=2] 
1X15=2] [X16=0] 1X17=0] 1X18=0] 1X19=1] 1X20=0] 
1X21=1] 1X22=1] 1X23=0] [X24=t! 1X25=0] [X26-0] 
1X27=0] 1X28=3] 1X29=4] 1X30=0] 1X31=0) 1X32=0] 
1X33=0] [X34=0] 1X35=1] 

EVENTS  COVERED  27 
5  TOTALS 

(70  STARS  BUILT) 


FOR  THE  BEST  SOLUTION  ABOVE,  S=  2  3E-004 

WITH  BETA=  3  00  THE  BEST  CLUSTERING  AT  THIS  LEVEL  IS  FOR  K=3 
BEGINNING  CLASSIFICATION  BELOW  HIERARCHY  PATH  2-0 


SEED  —COSTS--- 
SPAR 

30  20 


The  fint  elate  n  best  tuidivui 
ei  into  3  tvhclatiei 


EXPERIMENT  1  K=2.  CRITERION=F 


THE  1  BEST  CLUSTERINGS  FOLLOW 


ITER  CLASS*  VL-RULE 


SEED  - -COSTS- -- 

SPAR 


V.  V.  «•_  -■ 


\  A'V.  A  -• 


2  1  [Xl  =  4  8]  [X2=0] [X3=0J [X4  =  l  2] [X8= 1  3] [X7=3] 

[X8=l] 1X9=1] [Xll=l] :X12=1] [X13=0] [X14=2] [X1S=2] 
[X18=0] [X17=0] [X18=0] 1X19=1] [X21=0] [X22=3] 
[X23=0] [X24=0] [X25=0] [X28=2] [X27=l] [X28=0] 
[X29=4] [X30=0] [X31=0] [X32=0] [X33=0] [X34=0] 
[X3S=0] 

EVENTS  COVERED  11.12.15.17,19 
2  2  [Xl=3  8] [X2=0] [X3=0] [X4  =  l  2] [X7=2] [X  =  1  i 

[X9=0]  CXI  1= 1 ]  [X12= 1 ]  [X13=0] [X14=2] CX15=2! 
[X18=0] [X17=0]  [X18=0]  C X 1 9= 1 3 [X21=0] [X22=3] 
[X23-0] [X24=0] [X25=0]  [X28=2]  C  X27  =  1 3  1X28=0] 
[X29=4] [X30=0] [X31=0] [X32=0] [X33=0] (X34=01 
[X3S=0] 

EVENTS  COVERED  13.14.16.18,20 
2  TOTALS 

(12  STARS  BUILT) 

FOR  THE  BEST  SOLUTION  ABOVE,  S=  4  7E*003 


EXPERIMENT  1:  K=3,  CRIT£RION=F 

THE  1  BEST  CLUSTERINGS  FOLLOW...  (5984  MS) 

ITER/CLASS*  VL-RULE 

4  1  CX1=3  5] [X2=0] [X3=0] tX4=2] [X7=2](X8=1] [X9=0] 

[X10=l.  2] CXI  1  =  1]  [X12=l] £X13=0] [X14=2] [X15=2] 
[X16=0] [X17=0] [X18=0] [X19=l] [X21=0] [X22=3] 
[X23=0] :X24=0] [X25=0] [X26=2] (X27= 1 1 [X28=0] 
[X29=4] [X30=0] CX31 =03  [X32=0] [X33=0] [X34=0] 
[X35=0] 

EVENTS  COVERED  13.18,18 

4  2  [Xl=3.  8]  [X2=0] (X3=0](X4=1  2]  [X5=0]  [X6=  1  ] 

[X7=2 ,3]  [X8=l]  (X9=0.  1]  !X10=0]  CXU  =  li  (X12=l) 
[X13=0] [X14=2] 1X15=2] [X16=0] [X17=0] [X18=0] 
;X19=11 ;X20=0] [X21=0] [X22=3] [X23=0] [X2*=0] 
[X25=0] [X26=2] 1X27=1] [X28=0] [X29=4j [X30=0] 
:x31=0] [X32=0] [X33=0] [X34=0] [X35=0] 

EVENTS  COVERED:  12.14 

4  3  [XI =4 . .6] [X2=0] [X3=0l [X4= 1 .  2] [X5=l ] [X8=t  3) 

[X7=3] [X8=ll [X9=ti [Xll=l] [X12= 1 ] [X13=0] [X14=2] 
[X15=2] [X16=0] [X17=0] [X18=0] [X19=I] [X21=0] 
[X22=3] [X23=0] (X24=0' [X25=0] [X26=2! [X27=l] 
[X28=0] [X29=4] [X30=0] [X3l=0] [X32=0] [X33=0] 
[X34=0] [X35=0] 

EVENTS  COVERED  11.15.17 

4  EXCEPTIONAL  EVENTS  19,20 

4  TOTALS 

(38  STARS  BUILT) 

FOR  THE  BEST  SOLUTION  ABOVE.  S=  8  2E-003 


EXPERIMENT  1  K=4,  CRITERION=F 

THE  1  BEST  CLUSTERINGS  FOLLOW  (15354  MS) 

ITER/ CLASS#  VL-RULE 

2  1  :X1=5] [X2=0] [X3=0] [X4=2] [X8=3] :X7=2,3] [X8=l] 

:x9=o.i; : x  10=21  :xn=i;  :xi2=u  1x13=01 3x14=23 
:xi5=2i ;xi8=o] :xi7=o] :xie=o] 3x19=13  ;x2o=oi 

[X21 =0] [X22=3] [X23=0] 'X24=0I [X25=o:  X28=2] 
;x27=r,  ;x28=o;  1x29=4;  ;x30=o]  ;x3i=o]  ;x32=o] 


Tht$  to  tut  ion  it  belt  according 
to  heuriitic  S  for  the  tecond 
level  clottei  which  ipht  clan 


SEED  —COSTS— 
SPAR 

18  93 


SEED  —  COSTS— 
SPAR 

11  6 


WES 


19 


22 


1X33=0] (X34=0] 1X35=0] 

EVENTS  COVERED  11,18 

2  2  [Xl=4  6] [X2=0] 1X3=0] 1X4=1] 1X6=2  311X7=3] 

[X8=ll  1X9=1 ]  [X10=0  ll  [Xll  =  l]  [X12=l]  1X13=0] 

[X14=2! [X15=2] 1X16=0] [X17=0]  1X18=0] CXI  9= 1 ] 

1X20=0] 1X21=0) 1X22=31 1X23=01 1X24=01 1X25=01 
1X26=2] 1X27=1] [X28=0l [X29=4] 1X30=0] 1X31=0] 

1X32=0] 1X33=01 1X34=0] 1X35=0] 

EVENTS  COVERED  17,19 

2  3  [Xl=3  6] 1X2=0] 1X3=0] 1X4=2] 1X5=1] 1X6=0  2)  13  69 

1X7=2] 1X8=1] 1X9=0] [XI 1=1 l 1X12=1] [X13=0] (X14=2) 

[X15=2]  1X16=0] 1X17=0] 1X18=0] 1X19=1] [X2l=0] 

1X22=3] 1X23=0] 1X24=0] [X2S=0] [X26=2! 1X27=1] 

1X28=0] 1X29=4] 1X30=0] 1X31=0] [X32=0] 1X33=0] 

1X34=0] 1X35=0] 

EVENTS  COVERED  13,16,20 

2  4  1X1=3  6] [X2=0] 1X3=01 1X4=1  . 2] 1X5=0] 1X6= 1]  14  30 

1X7=2. 3] 1X8=1] 1X9=0, 1] 1X10=0] [Xll=l] [Xl2=l] 

1X13=0] 1X14=2] 1X15=21 1X16=0] 1X17=0] 1X18=0] 

1X19=1] [X20=0] 1X21=0] 1X22=3] [X23=0] 1X24=0] 

1X25=0] 1X26=2] 1X27=1] 1X28=0] 1X29=4] 1X30=0] 

1X31=0] 1X32=0] 1X33=0] 1X34=0] [X3S=0] 

EVENTS  COVERED  12, 14 

2  EXCEPTIONAL  EVENTS  15 

2  TOTALS  127 

(80  STARS  BUILT) 

FOR  THE  BEST  SOLUTION  ABOVE,  S=  8  1E*003 

WITH  BETA=  3  00  THE  BEST  CLUSTERING  AT  THIS  LEVEL  IS  FOR  K=2 
BEGINNING  CLASSIFICATION  BELOW  HIERARCHY  PATH  3-0 


EXPERIMENT  1  K=2 ,  CRITERION=F 

THE  1  BEST  CLUSTERINGS  FOLLOW  (2194  MS) 

ITER/CLASS#  VL-RULE 

2  l  1X1=3  8]  1X2=01  1X3=2] [X4=l] 1X8=1  3][X7=0] 

[X8= 1  2] [X9=0. 1] 1X10=1  2] 1X11=1] [X12= 1 ] 

1X13=0] 1X14=2] 1X15=2] 1X18=0] 1X17=0] 1X18=0] 
1X19=1] [X20=0] 1X21=31 1X22=0,1] 1X23=1] [X24=l] 
1X25=0] 1X26=0] 1X27=0] [X28=0] 1X29=4] 1X30=0] 
1X31=0] [X32=0] 1X33=0] 1X34=0] 1X35=0] 

EVENTS  COVERED  1,2,3.6,8,10 
2  2  1X1=3  6] 1X2=0] [X3=2] 1X4=1] 1X5=0] 1X6=1  3] 

1X7=0. 1] 1X8=1] 1X9=0. 1] 1X11= t] [X12=l] 1X13=0] 
1X14=2] 1X15=2] 1X16=0] 1X17=0] 1X18=0] [X19=l] 
1X20=1] 1X21=3] 1X22=0.1] 1X23=1] 1X24=1] 1X25=0] 
1X26=0] 1X27=0] 1X28=0] 1X29=4] 1X30=0] 1X31=0] 
1X32=0] 1X33=0] 1X34=0] [X35=0] 

EVENTS  COVERED  4. 5, 7, 9 
2  TOTALS 

(12  STARS  BUILT) 

FOR  THE  BEST  SOLUTION  ABOVE,  S=  5  3E-003 


SEED  --COSTS--- 

SPAR 

1  378 


5  284 


682 


EXPERIMENT  1  K=3,  CRITERION  =  F 


Clan  !  it  bat  lubdivided  into 
!  lubcla na 


Th it  lolution  if  but  according 
to  heurntic  S  for  the  itcond 
level  cloiici  which  iphl  clan 
S 


THE  l  BEST  CLUSTERINGS  FOLLOW 


(5358  MS) 


ITER/CLASSS  VL-RULE 


n 

y 


2  1  [Xl=4  8] [X2=0] [X3=2] [X4=l] [X8=l  3][X7=0) 

[X8=l  2] [X9=0. 1) [X10=l  2] [XI 1 = 1 1 [X12=l] 

[X13=0] [X14=2] [X15=2] [X1C=0] [X17=0] [Xt8=0] 
[X19=l] [X20=0) [X21=3] tX22=l) (X23=l) tX24=l] 
[X25=0] [X26=0] CX27=0] CX28=0] [X29=4l 1X30=0) 
[X31=0] (X32=0) [X33=01 [X34=0] [X35=0] 

EVERTS  COVERED:  1.2,8.10 

2  2  [Xt=5  6][X2=0HX3=2)  [X4=l]  tXS=0]  (X8=l  3] 

[X7=0, 1] [X8=l) [X9=0.l! [Xll=l] CX12=1) CX13=0) 

CXI 4=2]  [X15=2] CX18=0) C  X 1 7 =0 ] [X18=0) [X19=t] 
[X20=l] [X21=3) [X22=0, 1] [X23=t] [X24=l] [X25=0) 
[X28=0] 1X27=0) CX28=0] [X29=4] (X30=0) [X31=0) 
CX32=0] [X33=0] [X34=0] [X35=0] 

EVERTS  COVERED:  5.7.9 

2  3  [Xl=3] [X2=0j[X3=2][X4=l] [X5=0] [X8=l  2] [X7=0.1] 

[X8=l.  2]  CX9=0, 1)  1X10=1  . .2] [Xll=l] [X12=l] 
(X13=0) CX 14=2] [X15=2] [X18=0] fX17=0] [X18=0] 
1X19=1) tX21=3] [X22=03 [X23=l) [X24=l] [X25=0) 
[X28=0] [X27=0l [X28=0] [X29=4] [X30=0] [X3l=0) 
[X32=0] tX33=0] [X34=0] [X35=0] 

EVERTS  COVERED:  3.4,8 

2  TOTALS 

<30  STARS  BUILT) 

FOR  THE  BEST  SOLUTIOR  ABOVE.  S=  9  2E*003 


EXPERIMEHT  1:  K  =  4.  CRITESIOR=F 

THE  1  BEST  CLUSTERIRGS  FOLLOW  (7030  MS) 

ITER/CLASS*  VL-RULE 

1  1  !X1=4.  8] [X2=0! CX3=2) [X4=l] [X«=ll (X7=0.1) [X8=l) 

[X9=01 [Xll=l] txi2=ll [X13=0] [X14=21 [X15=2! 

[X 18=0] 'X17=01 CX 18=0) [X19=ll [X21=3) [X22=t] 
;X23=1] :X24=1) [X2S=0l [X28=0] CX27=0) [X28=0I 
1X29=4) 1X30=01 [X31=0) )X32=0) [X33=0] [X34=0) 
[X35=0l 

EVERTS  COVERED  1.7.10 

1  2  CX1=5  8) CX2=0| iX3=2) [X4=t! [X5=0; tX6=2  3! 

[X7=0]  [X8=U  (X9=l)  1X10=0  1)  ;xil  =  l)  1X12=1) 

[X13=0! CX 1 4=2) [X15=2I 1X18=0) CX17=0! 1X18=0) 

C  X 1 9= 1 ] (X2t=3)  [X22= 1 ] [X23= 1 ] [X24=t] 1X25=0! 
[X28=0] [X27=0] [X28=0] )X29=4l )X30=0) [X31=0] 
[X32=0]  ;X33=0)  C X34 =0 ] !X35=0J 
EVERTS  COVERED:  2.5 

1  3  CXI =3  4) [X2=0I [X3=2! CX4=l! [X5=0) :X6=1  3) 

lX7=0] ;X8=2) CX9=0.1J tX10=l  2) iXll=l) 1X12= 1 1 
CXI 3=03  CX 1 4 =2]  CX15=2)  iX16=0] CX17=0) )X18=0! 
:xi9=l)  )X2O=0i  ;x2l=3]  :X22=0. 1)  )X23=1]  i'X24  =  l] 
[X25=0] CX28=0) [X27=0] !X28=0! !X29=4i )X30=0] 
:X31=0] CX32=0l CX33=0] ;X34=0! [X3S=0l 
EVERTS  COVERED:  3,8,8 

1  4  [XI  =  3  5)  CX2=0!  :X3=2HX4=1)  )X5=0]  )X6=2  3) 

[X7=i]  [xa=u  [x9=o,  u  ;xio=i  2]  cxi  1= 1  ]  ;xi2=  1 : 

C X 1 3=0 ]  :xi4=2)  CXI 5=2 ] CX 10=0]  ;X17=0) !XI8=0) 

[XI 9=  l !  :X20=1)  :X21  =  3)  ;X22=0l  [X23=ll  )X24=U 
CX25=0! CX28=o: :X27=0j CX28 -0] ;X29=4I (X30=0) 

CX31 =0] )X32=0) !X33=0] )X34=0) )X35=0] 

EVERTS  COVERED  4.9 
1  TOTALS 

MO  STARS  BUILT) 


SEED  --COSTS - 

SPAR 

1  140 


SEED  —COSTS  — 

SPAR 

1  89 


*3 

m 

m 

55 

Jf 

148 


ft 


FOR  THE  BEST  SOLUTION  ABOVE,  S=  9  6E-003 

WITH  BETA:  3  00  THE  BEST  CLUSTERING  AT  THIS  LEVEL  IS  FOR  K=2 
BEGINNING  CLASSIFICATION  BELOW  HIERARCHY  PATH  4-0 


Clan  3  n  best  subdivided  in  to 
l  tvbclanc i 


EXPERIMENT  1  K=2.  CRITERION=F 


THE  1  BEST  CLUSTERINGS  FOLLOW 


(3988  MS) 


ITER/CLASS*  VL-RULE 


1 


[X1=0  .2] [X2= 1 3 [X3=l  2][X4=1] [XS=l! [X8=l  3) 

[X7=l  ,3]  [X8=l  2]  [X9=0,  t)  fXll  =  l]  [X12=l]  [X13=0] 

[X14=2] (XI 5=2 ] [X18=0] [X17=0] [X18=0] (X19=I] 
[X21=1.2] [X22=2] [X23=0] (X24= 1 ) [X25=0] [X28=0] 
[X27=0] [X28=3] [X29=4] [X30=0] (X3I =0] [X32=0] 

(X33=0] [X34=0] 1X35=1] 

EVENTS  COVERED:  38,38,41,43.45.48 
2  [X1=0  3] [X2=l] [X3=l  2] [X4=0  1 I [X5=03 (X7= 1 ] 

[X8=l  2] [X9=0. 1] [XI 1= 1 ] [XI 2= 1 ] [ X 13=0] (X14=2) 

( X 1 5=2 ] [X16=0] [ X 17=0] [X18=0] [X19=l] (X20=0! 

[X21=l .21 [X22=2] [X23=0] [X24=0] [X25=0] [X2S=0] 
[X27=0] [X28=3] 1X29=4! [X30=0] [X31=0] [X32=0! 

[X33=0] [X34=0] [X35= 1 1 

EVENTS  COVERED  31.32.33,34.35,37,39.40,42,44.47 
TOTALS 


SEED  —COSTS— 
SPAR 

38  1722 


This  solution  if  best  according 
to  heurntic  S  for  the  second 
level  clanei  which  split  class 

4 


42 


1525 


3247 


(15  STARS  BUILT) 

FOR  THE  BEST  SOLUTION  ABOVE,  S=  2  8E*004 


EXPERIMENT  1  K=3.  CRITERION=F 


THE  1  BEST  CLUSTERINGS  FOLLOW 
ITER/CLASS*  VL-RULE 


(7678  MS) 


1 


[Xl=l  3] [X2= 1 
[X8=2! [X9=0, 1 ] 
(X 15=2 ] :X16=0 
[X21 = 1 ,2] [X22= 
1X27=01 :X28=3] 
[X33=0! [X34=0] 
EVENTS  COVERED 

2  [X1=0  2] [X2=l 

[X7=l .3] (X8=t 
[X14=21 [X15=2 
[X21 = 1 . 2! (X22= 
;X27=0] ;X28=3) 
[X33=0] [X34=0] 
EVENTS  COVERED 

3  1X1=0  l] ;X2=1 
[X8= 1  -  3]  [X7  =  l 
[XI 3=0 ] (X14=21 
[Xt  9= 1 ]  [X20=0] 
[X25=01 [X26=01 
[X31=0!  [X32=0] 
EVENTS  COVERED 

TOTALS 


! 1X3=1  2] (X4= 

'X11  =  U  :X12=1! 
[X17=0] [X18=0] 
2! [X23=01 1X24= 
[X29=4] [X30=0] 
[X35= 1 ] 

31,32.34,37. 
] [X3=t  2 !  !X4  = 

2] (X9=0 , 1 1 [XI 
[X 16=0]  (X 17 =0] 
2] ;X23=0J [X24= 
[ X29= 4 j  [X30=0] 
[X35= 1 ] 
38,38.41,43. 
3 [X3=t  2] [X4= 

; [X8=t; [x9=o, i 
[XI 5=23  [X18=0] 
[X21=l .2! [X22= 
[X27=0] [X28=3! 
[X33=0i [X34=01 
33,35,39,40 


0  l!  (XS=0! [X7  =  l] 
(XI 3=0] [ X 14=2] 

(X 1 9= 1 ! [X20=0] 

0] [X25=0! [X26=0! 
[X31=0] [X32=0] 


SEED  —COSTS— 

SPAR 

31  569 


42,44,47 

tl [X5=l] [X6= 1  3! 

1=1] (X12=l! [X13=0] 
[X 18=0] [X19= 1 3 
1] [X25=0] [X26=0] 
[X3I=0] [X32=0] 


38 


1722 


45,48 

0  l ] [X5=0] 

] [XI 1=1] [X12=1] 
;xi7=o] [xie=o] 

2] :X23=0] [X24=0] 
[X29=4] ;X30=0] 
[X35= 1 ] 


33 


284 


2575 


(24  STARS  BUILT) 

FOR  THE  BEST  SOLUTION  ABOVE.  3=  7  0E-0O4 


WWW 


EXPERIMENT  1  K=4 ,  CRITERION=F 


THE  1  BEST  CLUSTERINGS  FOLLOW  .  <23388  MS) 

ITER/CLASS*  VL-RULE  SEED  —COSTS— 

SPAR 

5  1  1X1=1] 1X2=1] 1X3=2) 1X4=0.  1] [X8=2  3] [X7=1.3]  38  62 

1X3=1!  1X9=1] 1X10=1  .2] [ X 1 1  =  1 ] tX12=t] 1X13=0] 

C  X 1 4=2]  [X15=2l  1X16=0] (X17=0] CX18=0] 1X19=1] 

1X20=0] 1X21=2] [X22=2] 1X23=0] 1X24=0.1! 1X25=0] 

[X26=0] 1X27=0] [X28=3] 1X29=4] 1X30=0] 1X31=0) 

1X32=0] [X33=0] 1X34=01 {X3S=I] 

EVENTS  COVERED  35.43 

5  2  [Xl=0. .2! [X2=U 1X3=1  2][X4=1] 1X5=1] [X8=l  3!  41  428 

[ X7  =  1  ]  1X8=2)  (X9=0.  l!  [XU  =  1]  (X 12=  1 J  :X13=0] 
tXl 4=2] 1X15=2] [X16=0] [X17=0] 1X18=0] [X19= 1 ] 

[X2 1=1 .2]  [X22-2] 1X23=0] [X24= 1 i 1X25=0) 1X26=0] 

(X27=0l 1X28=3] [X29=4] 1X30=0] [X31=0] CX32=0] 

1X33=0] 1X34=0] [X3S= 1 ] 

EVENTS  COVERED  36.38.41.45 

5  3  [X1=0] [X2=l] CX3=1  2] tX4=l] tX6=l .  3] tXT=l]  33  68 

[X8=l] [X9=0] [XI 1= 1 ] (XI 2= 1 ] [X 13=0] [X14=2] 1X15=2] 

[X 18=0] [ X 1 7 =0 ] 1X18=0] [XI 9= 1 ] 1X20=01 [ X2 1  =  1 ] 

1X22=2] [X23=01 [X24=0. 1) [X25=0l tX26=0! [X27=01 
1X28=31 1X29=41 [X30=01 1X31=01 1X32=01 1X33=01 
1X34=01 1X35=1] 

EVENTS  COVERED  33.39.40.46 

5  4  1X1=1  311X2=111X3=1  211X4=0  1 11X5=0] 1X7= 1 ]  37  569 

1X8=2) 1X9=0. 1) 1X11=11 [X12=ll 1X13=0! 1X14=2] 

1X15=21 1X16=0] 1X17=0! 1X18=0! 1X19=11 1X20=0] 

1X21=1.21 1X22=21 1X23=01 1X24=01 1X25=0! 1X26=0] 

1X27=01 1X28=31 1X29=4] 1X30=01 [X31=0l 1X32=0] 

1X33=01 1X34=0) 1X35=1 1 

EVENTS  COVERED  31.32.34.37.42.44,47 

5  TOTALS  1127 

(70  STARS  BUILT) 

FOR  THE  BEST  SOLUTION  ABOVE.  S=  7  2E*004 

WITH  BETA=  3  00  THE  BEST  CLUSTERING  AT  THIS  LEVEL  IS  FOR  K=2  Clan  (  n  bent  tubdivided  into 

2  tubclanei  Further  develop¬ 
ment  o/  the  hierarchy  n  inhi¬ 
bited  by  the  parameter  MAX- 
HEIGHT  let  to  2,  i  e,  the 
hierarchy  n  to  have  only  tvo 
leveh 

ACTIVITY  STATISTICS  The  procedure  uie  counti  are 


CENDIST 

=  94 

CRITVAL 

=  15939 

CLUSTER  = 

79 

t Sown  The  heaviett  ute  it  for 

CMPCOV 

=  0 

EXTEND 

=  5938 

FREECPLX  = 

7925 

GEXRLIZ  = 

11151 

REFLEV  which  it  a  function 

INTRSCT 

=  12512 

NID 

=  313 

NUMSEL  = 

0 

NE.CPLX  = 

8671 

that  countt  the  number  of 

REDUCE 

=  5938 

REFHIGH 

=  34046 

RET  HUM  = 

0 

RETUNION  = 

62042 

valuet  in  the  value  li$t  part  of 

REF  LEV 

=849959 

REFLOW 

=110394 

SETMAP  = 

15939 

SETLEVELMA= 

0 

a  telector  TCOITZR  it  a 

STAR 

=  532 

SEMANTICS 

=  1897 

SYNDIST  = 

0 

TRIM  = 

1307 

boolean  function  which  text  to 

TCOVER 

=479364 

DEGISCT 

=  0 

CLUSTERING: 

5 

TABLESETUP= 

5 

tee  if  one  complex  covert 

8ESTC 

=  3983 

MCARD 

=  26610 

GEWPATH  = 

325 

CLEARCV  = 

30 

another  It  it  uted  heavily  to 

SAVECV 

=  79 

STAR2 

=  0 

determine  which  eventt  are 

covered  by  a  complex 


APPENDIX  B 


CLASSIFYING  BLOCKS-WORLD  FIGURES 


B.l.  Problem  description 

Given  are  9  blocks-world  figures  each  composed  of  2  to  four  connected  parts.  The 
connections  are  denoted  by  the  predicates  ontop,  inside,  and  next.  Each  part  is 
described  by  the  functions  shape,  size,  and  texture.  The  domain  of  the  function  shape  is 
a  hierarchy  of  values  in  which  the  shapes  square,  rectangle,  diamond,  and  triangle 
generalize  to  the  value  polygon  and  the  shapes  circle  and  ellipse  generalize  to  the  value 
curved. 


B.2.  Input  data  file 


The  following  declarative  statements  are  provided  to  INDUCE/3  to  define  this 
problem. 


E 

[SHAPE=SQUARE. RECTANGLE. DIAMOND. TRIANGLE]  =>  [SHAPE=PCLYGON] . 
E 

[SHAPE=CIRCLE . ELLIPSE]  =>  [SHAPE=CURVED] . 


The  E  directive  begins  the 
definition  of  a  generalized 
node  in  the  value  hierarchy  m 
the  domain  of  a  function 


The  \f  and  A  directives  are  uted  to  introduce  each  object  description  Each  object  hat  an  astociated 
decision  category  or  clast.  Tht  clast  assignments  are  not  uted  by  the  cluttering  algorithm  The  syntax  it 
present  for  non* clustering  applications  such  at  building  generalized  rules  which  discriminate  between  multiple 
classes  of  objects 


M 

A 

[0NTQP(P1 ,  P2)  ]  [0NTQPCP2.P3)] 

[SI2ECP1 ) =1 ] [SIZE (P2) S1 ] [SIZECP3) =2] 

[TEXTURE (PI ) =0] [TEXTURE (P2) - 1 J [TEXTURE (P3) =0] 
[SHAPE(P1)=DIAH0ND]  [SHAPE (P2) =CIRCLE]  [SHAPE (P3)  =USHAPE] 
s> [D=i]  . 


CONTOP (P 1 .P2) ] 

[SIZ£(Pl)=l] [SIZE(P2)=l] [SIZE (P3) =0] [SI2E(P4)=0] 

[TEXTURE (? 1 ) =0] [TEXTURE(P2) -0] [TEXTURECP3) =1 ] [TEXTURE(P4)  =1] 
[SHAPE  (PI ) =SQUAR£] (SHAPE(P2) = RECTANGLE] 

[SHAPE(P3) -CIRCLE] (SHAPE(P4) =CIRCLE] 

=  >[D=1]  . 

M 

A 

[0NT0P(P1 ,P2)] [0NT0P(P2,P3)] 

[SIZE(P1)=1] [SIZE(P2)=l] [SIZE (P3) =2] 

[TEXTURE (P1)=0] [TEXTURE (P2)=l] [TEXTURE(P3) =0] 

[SHAPE  (P1)=TRI  ANGLE] [SHAPECP2) =RECTANGLE] [SHAPE (P3 ) =ELLIPSE] 
=>[D=1]  . 

M 

A 

[0NT0P(P1 ,P2) ] [ONTOP (PI .P3)] 

[SIZE(P1 ) =2] [SIZE(P2)=1] [SIZE(P3)=l] 

[TEXTURE(Pl)  =0]  [TEXTURE(P2)  =  1]  [TEXTURE(P3)  =1] 
[SHAPE(P1)=ELLIPSE] [SHAPE(P2) =CIRCLE] [SHAPE (P3) =CIRCLE] 

=  > [D=  1  ]  . 

M 

A 

[0NT0P(P1 ,P2) ] [ONTOP (P2 .  P3)  ] 

[SIZE(P1 ) =2] [SIZE(P2)=l] [SIZE(P3)=2] 

[TEXTURE ( P 1 ) = 1 ] [TEXTURE(P2)=0] [TEXTURE (P3) = 1 ] 

[SHAPE (P 1 ) ^CIRCLE] [SHAPE (P2) =TRI ANGLE] [SHAPE (P3 ) =USHAPE] 

=  >[D=1]  . 

M 

A 

[ONTOP (PI ,P2)]  [ONTOP (P2 . P3) ]  [0NT0P(P2 ,P4)  ] 

[SIZE(P1 ) =1]  [SIZE(P2)=l]  [SIZE (P3) -0]  [SIZE(P4)=0] 

[TEXTURE (Pi) =1] [TEXTURE(P2)=0] [TEXTURE(P3) =0] [TEXTURE(P4) =0] 
(SHAPE (P 1 ) = ELLIPSE] [SHAPE (P2) = RECTANGLE] 

[SHAPECP3)  =Cl]lCLE]  [SHAPE (P4)  =CIRCLE] 

=  >[D=l]  . 

M 

A 

[ONTPP (P 1 . P2) ] 

[SIZE(Pl)=l] [SIZE(P2)=t] 

[ TEXTURE ( P l ) = l ] [TEXTURE(P2)=l] 

[SHAPE(P1 ) = TRIANGLE] (SHAPE(P2) = ELLIPSE] 

=  >  [D=  1  ]  . 

M 

A 

[ONTOP (PI . P2) ] 

[SIZE(Pl ) =2] [SIZE(P2)=l] 

(TEXTURE (Pi )=l] [TEXTURE (P2)=l] 

[SHAPE (P l ) =RECT ANGLE] [SHAPE (P2) ^CIRCLE] 

=  >[D  =  1]  . 

N 

A 

[ONTOP (P l . P2) ] [ONTOP (P2 , P3) ] 


[SIZE(P1)=0. .0] [SIZECP2) -2] [SIZE(P3)=2] 

[TEXTURE (PI )=l] [TEXTURE CP2) =1] [TEXTURE(P3) =1 ] 
[SHAFE(P1)=SQUARE] [SHAPE (P2) =ELLIPSE] [SHAPE  (P3)  =USHAPE] 
=  >[D=1]  . 

P 


Zzy/////' 


META  l 

ALTER  4  These  statements  assign 

VL.MAXSTAR  4  values  to  control  parameters 

AQMAXSTAR  4  The  parameter  META  con - 

NCONSIST  4  trole  the  construction  of  zero- 

VLCRIT(l)  -1  place  functions  such  as  the 

VLTOL(l)  0  number  of  parts,  the  number 

VLCRIT(2)  -2  of  different  values  taken  by  a 

VLT0LC2)  0  function,  etc  VLMAXSTAR 

VLCRITC3)  3  it  the  number  of  complexes 

VLT0LC3)  0  maintained  during  star  build- 

EXTMTY  •  mg  AQUAXSTAR  is  the 

EQUIV  number  of  complexes  mam- 

PA  tamed  during  attnbutcs-only 

QUIT  star  building  NCONSIST 

gives  the  number  of  alterna¬ 
tive  complexes  constructed 

while  building  Gle\FJ  which  have  been  specialized  enough  to  cover  no  events  in  set  F  The  IXCRIT  specifications  give  the 
order  of  application  of  elementary  criteria  in  the  LEF  By  the  specification  *•  1  ’  the  indication  to  maximize  (denoted 
by  the  minus  sign )  the  value  of  crilirion  ‘I  ’  This  criterion  measures  the  number  of  events  covered  The  second  criterion 
maximizes  the  number  of  selectors  in  the  complexes  The  third  criterion  minimizes  the  number  of  events  in  F  which  are 
covered  The  directive  EXT.MTY  causes  the  object  descriptions  to  be  augmented  with  'MOST-'  and  'LEAST-'  type 
predicates  The  directive  EQUIV  causes  the  object  descriptions  to  be  augmented  with  'SAME-'  type  predicates  The  PA 
directive  prints  out  the  control  parameter  values 


B.3.  Results  generated  for  k=2 


INDUCE  3  -  VERSION  AS  OF  AUCUST  25  1984 

THIS  RUN  «ADE  ON  84/09/18 
INITIALIZING  (MFICS) 


VARIABLE  *A”Z 

VTYPE 

VCOST 

TRACE 

#PT 

LIN 

t 

STOPS 

»P 

LIN 

1 

PRINT  RULES  TRUE 

#DIFF 

LIN 

l 

SHAPE 

STR 

I 

SIZE 

LIN 

1 

This  parameters  block  shows 
the  values  of  various  control 
parameters  used  by  IN¬ 
DUCE/S  The  function 
SHAPE  has  a  structured 
domain  The  function  SIZE 
and  the  meta-variables  0PT 
Inumber  of  parts  of  a  certain 
type I  #P  (nomA<r  of  parts/, 
and  dkDIFF  (number  of 
different  values )  all  have 
linear  domains  All  other 
funclions/prc  die  at  es/ variables 
have  nominal  domains 


The  control  parameters  fall 


153 


r3 

v 

i 


£ 


rw 


£ 


PARAMETERS  GENERAL 

VL 

AQ 

L-RULE 

REGENSTAR 

1 

VLMAXSTAR 

4 

AQMAXSTAR  4 

MAXL 

'•‘ETATRIM 

1 

NCONSIST 

4 

AQCUTF1  20 

DESCTYPE 

DISC 

ALTER 

4 

LOST  FALSE 

EXTYTY 

TRUE 

MINCOVER 

100 

ESUIV 

TRUE 

MAXBACK 

0 

into  four  group*  general 
parameters  (GESERAL  head¬ 
ing).  graph-representation 
heuristic  control  parameters 
l\E  heading).  attribute- 
representation  heuristic  con¬ 
trol  parameters  (AQ  heading), 
and  background  inference  ap¬ 
plication  parameters  (L-RLEE 
heading) 


VLNF-3 

AQNF=2 

LRNF=4 

CRITERION  VLCRIT 

VLTOL 

AQCRIT 

AQTOL 

LRCRIT 

LRTOL 

-1 

0  00 

-1 

0  00 

-1 

0  00 

-2 

0  00 

2 

0  00 

2 

0  00 

3 

0  00 

-3 

0  00 

4 

0  00 

The  program  uses  three  LEFs. 
one  for  graph-represented  rule 
evaluations  (VLCRIT),  one 
for  subordinate  value  list  gen¬ 
eralization  using  the  ,4<2  pro¬ 
cedure  (AQCRIT).  and  one 
for  inference  rule  evaluation 
fLRCRIT) 


EATER  ONE  CHAR:  (P)  ARAKETERS .  <V)L1 .  (C)OVER,  (M)ODIFY,  (H)ELP  FOR  OPTIONS 

?  u  After  the  system  has  loaded 

the  p  roble  m  dec  laratio  ns,  it 

EATER  NUMBER  OF  SEEDS  FOLLOWED  BY  THEIR  EVENT  NUMBERS  becomes  interactive  with  the 

user  User  responses  are  in 
lower  case  The  u  command 
requests  the  cluster  operator 


*219 

NOW  COVERING  EVENT  1  AGAINST  9 

THE  FOLLOWING  RULES  COVER  SET  1 

THIS  RULE  COVERS  EVENTS  654321  (0  NEW) 

RULE  23  EVENT  SETS  l.  COSTSC-6-2  3)  -6  -1  0 

; sPS (TEXTURE=0) #0] 


In  the  present  implementa¬ 
tion,  seed  selection  is  per¬ 
formed  by  the  user  The  im- 
tial  seeds  are  events  1  and  9 
The  first  numeral  is  the  value 
of  k  The  word  RULE  in  the 
output  listing  means  “ com¬ 
plex  9 


Each  complex  (RULE)  is  listed  with  a  unique  rule  number  (e  g  .  23  for  the  above  complex),  a  list  by  event 
number  of  events  it  covers  (e  g,  events  6  5+321),  the  number  which  are  “new9  (this  is  meaningless  for 
clustering  problems),  and  the  scores  (COSTS)  on  the  evaluation  criteria  in  the  LEF  (e  g  ,  criteria  are  applied 
in  the  order  (-)l  (-)Z  3  which  have  scores  -6,  -I.  and  0,  respectively.  Criterion  l  is  to  minimize  the  number 
of  observed  events  covered  Criterion  2  is  to  minimize  the  number  of  selectors  in  the  complex  Criterion  3 
is  to  minimise  the  number  of  events  covered  in  the  against  set  F  A  minus  sign  preceding  the  criterion 
number  causes  the  use  of  the  negated  score.  Thus  the  LEF  used  is  to  mazimtze  the  number  of  observed 
events  covered  by  a  complex  (-1),  then  maximize  the  number  of  selectors  in  the  complex  (-2),  and  then 
minimize  the  number  of  events  covered  in  set  F  The  relational  operator  #  denotes  “not  equal9,  the  symbol 
#P5  denotes  “number  of  object  parts9,  the  symbol  #DIFF  denotes  “number  of  different  values  for9,  the  symbol 
*  denotes  “any  value 9 


NOW  COVERING  EVENT  9  AGAINST  1 

THE  FOLLOWING  RULES  COVER  SET  1 

THIS  RULE  COVERS  EVENTS  9  8  7  5  4  (0  NEW) 

RULE  43  EVENT  SETS  1.  COSTS (-6-2  3)  -5-10 

;«PS(TDCTURE=0)=0  ll 


The  stars  G(l\9)  and  G(9\l) 
are  built  to  determine  general¬ 
ized  ways  for  covering  each 
seed  with  conjunctive  con¬ 
cepts  which  optimise  the 
LEFs 


EVENTS  COVERED 
1  2  3  4  5  6 
EVENTS  COVERED 
4  5  7  8  9 

‘MULTIPLY -COVERED  EVENTS 

4  5 

UNIQUELY  DETERMINED 
1  2  3  6  7  8  9 

NOW  COVERING  EVENT  t  AGAINST  9  8  7  5  4 

THE  FOLLOWING  RULES  COVER  SET  1 

THIS  RULE  COVERS  EVENTS  6321  (4  NEW) 

RULE  194  EVENT  SETS  1.  COSTSC-6-2  3)  -4  -41  0 


The  program  analyzes  the  gen¬ 
erated  complexes  to  see  if  they 
are  disjoint  Here,  the  com¬ 
plexes  both  cover  events  +  and 
5  so  HID  is  performed  to  ad¬ 
just  the  completes  to  make 
them  disjoint 

This  is  the  beginning  of  the 
work  done  by  KID  First.  RE- 
FUKIOKS  are  built  for  thoie 
events  which  were  uniquely 


i 


■jS 
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covered 


FORALL-PS  (SHAPEaSgUARE)=FALSE]  ;forall-ps(shape=rectamcle)=false: 

FORALL-PS  (SHAPE=DIAMOND)  =FALSE]  [FORALL-PS  (SHAPE:  TRIANGLE)  :FALSE] 

FORALL-PS (SHAPEaCIRCLE)  =  FALSE]  [FORALL-PS (SHAP£=  ELLIPSE)  =  FALSE] 

FORALL-PS  (SHAPEaUSHAPE)  aFALSE]  [FORALL-PS(SHAPE=POLYGON)  aFALSE] 

FORALL-PS  (SHAPEaCURVED)  -FALSE]  [FORALL-PS  (SIZE=0)  aFALSE] 

FORALL-PS (SIZE=  1 )  = FALSE]  [ FORALL-PS (SIZE=2) =FALSEI  [  FORALL-PS  ( TED(TURE=0)  =  FALSE] 
FORALL-PS  (TD(TUR£=  1 )  =  FALSE!  (MST-ONTOP(Pt) ]  I0NT0P  (PI ,  P2)  ]  [SAXESIZE(P1  P2)] 
*HAPE(P 1 )  SRECTANCtJE]  [SHAPE(P2)*SgUAR£]  [SIZE(PI)ai]  [SIZE(P2)=1]  [  TEXTUREtPl ) -« ] 
TECTUR£(P2)  =  *] [aDIFF-SHAPE=3] [aDIFF-SIZE=2] [*DIFF-TEXTUREa2] 
a PS (SHAPE- CURVED )aO] [aPS(SHAPE=SQUARE) =0  1] [aPS (SHAPE: RECTANGLE) =  o  I] 

a PS (SHAPE: DIAMOND) =0  1] [ aPS CSHAPE=TR IANGLE) =0  1] [ aPS (SHAPE=CIRCLE) 83 ] 

aPS(SHAPE=ELLIPSE)=0  1 ! [aPS (SHAPE=USHAPE) :0  I ] [aPS (SHAPE: POLYGON) = i  2! 
aPS(SIZE=l)=2] [8PS(SIZE:2)=0  1] [8PS(SIZE=0)a3] [aPS (TEXTUREaO) =2  3] 

aPS (TEXTURE: 1)=1  2][aPS=3  4] 


NOV  COVERING  EVENT  9  AGAINST  654321 

THE  FOLLOWING  RULES  COVER  SET  1 

THIS  RULE  COVERS  EVENTS  987  (3  NEW) 

RULE  340  EVENT  SETS  1.  C0STS<-6-2  3)  -3  -40  0 

[FORALL-PS (SHAPE=SQUAR£)  =FALSE]  (FORALL-PS (SHAPEaRECTANGLE)  =FALSE] 

[ FORALL-PS (SHAPEaD I AMOND ) aFALSE] ! FORALL-PS (SHAPE: TR IANGLE) = FALSE] 

[FORALL-PS (SHAPEaCIRCLE)  =FALSE] [FORALL-PS (SHAPE=ELLIPSE) aFALSE] 

[ FORALL-PS (SHAPE=USHAPE) aFALSE] [FORALL-PS (SHAPEaPOLYGON) aFALSE! 

[FORALL-PS (SHAPE=CURVED) aFALSE] [FORALL-PS (SI ZEaO) aFALSE] 

[F0RALL-PS(SIZE=2) -FALSE]  [FORALL-PS(TEXTURE=0)aFALSE]  [FORALL-PS(TEXTURE=  1 )  ] 

[ MST-ONTOP (PI ) ] [0NT0P(P1.P2)1 [SAHETEXTUR(P1  P2)] [SHAPE(Pl)aPOLYGON] 

[SHAPE(P2) aCURVED] [SIZE(P1 ) a«] [SIZE(P2)aO] !TEXTURE(Pl)al] [TEXTURE(P2) = 1 ] 
[aDIFF-SHAP£=2  3]  (aDIFF-SIZEal  2] [aOIFF-TEXTUREal] [aPS(SHAPE=POLYGON) a  1 ] 

[aPS (SHAPEaCURVED)a 1 1 [aPS(SHAPE=SQUARE) =0  1] (#PS (SHAPEaRECTANGLE) =0  1] 

[ aPS (SHAPE: DIAMOND) =0] [ aQS (SHAPEaTRIANGLE) =0  1] [aPS(SHAPE=CIRCLE):0  1] 

[aPS(SHAPE=ELLIPSE)aO  tl (aPS<SHAPE:USHAPE)=0  1] [«PS(SIZEal)a3) [aPS(SIZE:2)83] 
[8PS(SIZE=0)=0  1] [aPS(TEXTURE=0)a0] [ aPS (TEXTURE: 1) =2  3] (aPS=2  3] 


7  5 


UNCOVERED  EVENTS  4  5 
NOW  COVERING  EVENT  1  AGAINST  9  8 
THE  FOLLOWING  RULES  COVER  SET  1 
THIS  RULE  COVERS  EVENTS  64321  (5  NEW) 

RULE  471  EVENT  SETS  1.  C0STS(-8-2  3)  -5  -39  0 
FORALL-PS  (SHAPEaSUUARE)  =  FALSE]  [FORALL-PS (SHAPEaRECTANGLE) aFALSE! 

[FORALL-PS  (SHAPE=DIAMOND)  aFALSE]  [FORALL-PS  (SHAPE=  TRIANGLE)  aFALSE] 

[FORALL-PS (SHAPE=CIRCLE) aFALSE]  [FORALL-PS (SHAPE=ELLIPSE)  =FALSE] 

[FORALL-PS (SHAPEaUSHAPE) =FALSE! [FORALL-PS (SHAPE=POLYGON) =FALSE] 

[  FORALL-PS  (SIZE=0)  aFALSE]  [FORALL-PS  (SIZE:  l )  aFALSE]  [FORALL-PS  (SIZE=2>  =FALSE! 
:fORALL-PS(TEXTURE=0)=FALSE!  (FORALL-PS  (TEDCTUREa  1)  =FALSE]  [MST-ONTOP(Pl)] 
[0NT0P(Pt.P2)] [SHAPE(P1)8RECTANGLE] [SHAPE (P2) 8SQUARE] [SIZE(PI)aO] [SIZE(P2)=l! 
[TEXTURE(P2)=a] [TEXTURE(P1 ) =«; [aDIFF-SHAPE=2  3] [aDIFF-SIZE:2] [ aDIFF-TEXTURE= 
[ *PS (SHAPE=POLYGON)  *3]  [ aPS(SHAPE=CURVED)  ao!  [ aPS  (SHAPEaSgUARE)  =0  1] 

[ aPS (SHAPEaRECTANGLE) =0  1) [*PS(SHAPE=DIAHOND)aO  1] [8PS (SHAPE=TRIANGLE) =0  1 

[aPS(SHAPE=CIRCLE)a3]  [aps(SHAPEaELLIPSE)  =0  1]  [aPS (SHAPEaUSHAPE)  =0  1] 

[aPS(SIZE=0)a3]  [aPS(SIZE=l)a2]  [aPS(SIZE=2)aO  I]  (*PS<TEXTUREal)=t  2] 
[aPS(TEXTURE:0)aO] [aPS=3  4] 


Nov  NID  tnei  to  fit  each  un¬ 
covered  event  to  a  complex 
inch  that  no  event  remain* 
multiply  covered  The  retail 
it  a  tel  of  complete!  which  are 
disjoint  or  weakly  intersect¬ 
ing  Here,  event  f  is  being 
fitted  to  each  complex  It  will 
remain  in  the  complex  which 
is  the  best  host  for  it 


NOW  COVERING  EVENT  9  AGAINST  85321 

THE  FOLLOWING  RULES  COVER  SET  1 

THIS  RULE  COVERS  EVENTS  9  8  7  4  (4  NEW) 

RULE  802  EVENT  SETS  1.  C0STS(-6-2  3)  -4  -37  0 

[ FORALL-PS (SHAPE= SgUARE) aFALSE] . FORALL-PS (SHAPEaRECTANGLE) aFALSE] 

[FORALL-PS (SHAPE: DIAMOND) aFALSE]  [FORALL-PS (SHAPE: TRIANGLE) aFALSE] 

'FORALL-PS  (SHAPEaCIRCLE)  aFALSE]  (FORALL-PS  (SHAPE:  ELLIPSE)  aFALSE] 

[FORALL-PS (SHAPE=USHAPE)  =FALSE]  [FORALL-PS (SHAPE=POLYCON) -FALSE! 

[FORALL-PS  (SIZE=0)  aFALSE]  [FORALL-PS  (SIZE=2)  =  FALSE]  [FORALL-PS  (TEXTUREaO)  =FALSE] 
["ST-ONTOP'PD]  ;ONTOP(P!  .PS)]  [ SHAPE (Pl)aCIRCLE]  [SHAPE(P2)  =  CURVED]  [SIZE(Pl)a«] 
[SIZECP2) so] [TENTURE(P2)al] ' TEXTUREIPl )=•: [eDIFF-SHAPE=2  3, [aDIFF-SIZEal  2] 

[ ao IFF- TEXTURE: 1  2! [aPS(SHAPE=ELLIPSE):0  1 ] [sPS(SHAPE=USHAPE) aO  1] 

[ aps (SHAPE=POLYGON ) =0  1 ] [ spS(SHAPE=CURVED ) *oi [ »PS (SHAPE= SgUARE) :0  1] 

[sPS(SHAPE:A£CTANGLE)=0  1] [sPS(SHAPE=D:A"CNO)aO  ' aPS(SHAPE: TRIANCLE) =0  1] 

[  a  PS  (SHAPEaCIRCLE)  S3]  [  aPS  (SIZE--2)  *3]  [  tPG  (SIZE=0)  :0  1]  [  aPS  (SIZE=  1 )  S3] 
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JS  JS 

£  k 


sc  k 


H  S 


•  „*» 


Sfl  % 


b:  :•: 


I  ft 


[  :PS( TEXTURE: 1) =2  3[ [iPS(TEXTUR£:0)=0  1[[IPS=2  3! 


NOJ  COVERING  EVENT  1  ACAINST  9874 

THE  FOLLOW  ING  RULES  COVER  SET  1  p 

THIS  RULE  COVERS  EVENTS  65321  (5  NEW) 

RULE  732  EVENT  SETS  l.  C0STS(-6-2  3)  -5  -40  0 

;fORALL-PS(SHAPE=SQUAR£)=FALSE: [FORALL-PS  (SHAPE:  RECTANGLE) ‘FALSE! 

;forall-ps(shape=diavond)=false: [forall-ps (shape: triancle) =false: 
;forall-ps(shape=circle)=false; [forall-ps (shape=ellipse)=falsei 
;forall-ps(shape=ushape)=false; [forall-ps (shape=polygon>=false) 

[  FORALL-PS  (SHAPE:CURVED):FALSE! [FORALL-PS (SIZE=0):FALSE! 

[FORALL-PS(SIZE= 1 ) =FALSE; [FORALL-PS (SIZE=2) =FALSE) [FORALL-PS (TEX TURE=0) -false: 
[forall-ps(texture=i)=false;  ;mst-ontopcpi) ;ontopipi ,P2>;  ;shape(pi)»rectancle; 
;shape(p2)ssquare;  ;size(poso:  [size(P2)=i;  :texture(p2)=»i  ;texture(pi):«: 

[:DIFF-SHAPE:3) [iDIFF-SIZE=2! [iDIFF-TEXTUR£:2! [=PS(SHAPE=P0LYG0N)=1  2! 
[:PS(SHAPE:CURVED)iO! [:PS(SHAPE:SQUARE)=0  1 ! ! =PS (SHAPE:RECTANGLE) =0  1) 

; cPS  (SHAP£=DIAMOND) =0  1] [ IPS (SHAPE=TRIANGL£) =0  1) [iPS(SHAPE=CIRCLE)i3l 

[:PS(SHAPE:E1LIPSE)=0  l! [ IPS (SHAPE=USHAPE) =0  l! C IPS (SIZE=0) 131 [IPS (SIZE= 1 ) = 1 
[•PS(SIZE=2)I31 [IPS(TEXTURE=1)=1  21 itPS(TEXTURE=0)*0] [IPS:3  41 


Now  event  5  i«  fitted  to  a  com- 
pie  X 


NOV  COVERING  EVENT  9  AGAINST  6321 

THE  FOLLOWING  RULES  COVER  SET  1 

THIS  RULE  COVERS  EVENTS  98754  <5  NEW) 

RULE  863:  EVENT  SETS  1.  COSTSI-6-2  3)  -5  -37  0 

! FORALL-PS (SHAPE=SQUAR£)  :FALSE1  [FORALL-PS (SHAP£=RECTANCLE)  =FALSC! 

;forall-ps (shape=diayond) =false; [forall-ps (shape= triangle) =false; 
!forall-ps(shape=circle)=false! [forall-ps (shape=ellipse)=false: 

; forall-ps (shape:ushape)=false: [forall-ps (shape=polygon):falsei 
[forall-ps (size:o)=false; :forall-ps (SIZE-2) :FALSE! 'FORALL-PS  (TEXTURE 
[ MST-ONTOP (PI ) ] [0NT0P(P1 ,P2)! [SHAPECP1 ) : * ! [SHAPE(P2)  ISIJUARE! [SIZE(Pl 
[SIZE(P2)I0!  lTEXTURE(P2)=«; [TEXTURE(Pl):*! [iDIFF-SHAPE:2  3] [iDIFF-S 
[ 3D  IFF- TEXTURE: 1  2i  [ IPS (SHAPE=ELLIPSE) =0  1 ! [IPS (SHAPE=USHAPE) :0  1 

;jps(shape-polycon)=o  tl [ips(shape:curved)io! [ips(shape:square):o 

: IPS (SHAPE: RECTANGLE) =0  l! [IPS(SHAPE:DIAYOND)=0! [IPS (SHAPE: TRIANGLE 
[iPS(SHAPE=CIRCLE)s3l [:PS(SIZE:2)«31 (iPS(SUE=0>:0  \) [iPS(SIZE=l)i3 

:  IPS  (TEXTURE:  0=2.  31  [:PS(TEXTURE:0):0  ll[IPS:2  31 


0) =  FALSE! 
)=«1 

IZE=I  2! 


1] 

;=c  i; 


RULE  COVERING  CLUSTER  1  (EVENTS  6321) 

RULE  194  EVENT  SETS  1.  COSTSC-8-2  3)  -4  -41  0 

;forall-ps (shape^square) =false] (forall-ps (shape=rectangle) =falsei 

•FORALL-PS (SHAPE=DIAMOND) =FALSE! (FORALL-PS (SHAPE: TRIANGLE) =FALSE] 
[FORALL-PS(SHAPE=CIRCLE)=FALSE! [forall-ps (shape=ellipse>=false; 
[FORALL-PS(SHAPE=USHAPE):FALSE!  [FORALL-PS(SHAPE=POLYGON):FALSE] 

[FORALL-PS  (SHAPE=CURVED)=FALSE! [FORALL-PS (SIZE:0) =  FALSE! 

;forall-ps<size=i)=false; [forall-ps (size=2):false; 

;forall-ps(texture=o)  =false;  ;forall-ps(texture=d=false;  [pst-ontopipdi 

[ ON TOP (P 1 , P2) ] [SAKESIZEIPl  P2)l [SHAPE(P I ) I RECTANGLE! [SHAPE(P2)IS8UARE1 
[SIZE(Pl)=t: [SIZE(P2)=U  !TEXTURE(P1)=»1 [ TEXTURE(P2) =•! [iDIFF-SHAPE=3 ! 
[•DIFF-SIZE=2) [:DIFF-TEXTURE=2l [IPS(SHAPE:CURVED)iO] ! «PS (SHAPE=SQUARE) =0 
[ *PS (SHAPE=RECTANGLE)  =0  l!  [IPS(SHAPE=DIA,“0ND)=0  .11  [»PS (SHAPE: TRIANGLE)  = 
[»PS(SHAPE:CIRCLE)#3! [#PS(SHAPE:ELLIPSE)=0  1 1 [IPS(SHAPE=USHAPE) =0  11 

[IPS(SHAPE=P0LYG0N):1  21 [:PS<SIZE:1):2I [IPS<SIZE=2>=0  11 [IPS (SIZE^O) *31 
[IPS (TEXTURE=0)  =2  .  3] [IPS(TEXTUR£: 1 ):1  .  2K«PS  =  3  41 


Now  that  each  multiply 
covered  event  hoe  been  fitted 
to  a  complex,  NID  it  finnhed 
The  complete  detcriptiom  of 
the  clusters  are  given  here 
An  edited  deieription 
eompnted  of  the  deicriptort 
which  ditcnminate  between 
clutters  i«  shown  in  Fig  6  5 
(upper  figure) 


RULE  COVERING  CLUSTER  2  (EVENTS  98754) 

RULE  863  EVENT  SETS  1.  C0STS(-6-2  3)  -5  -37  0 

[ FORALL-PS (SHAPE=SQUARE)=FALSE!  (FORALL-PS  (SHAPE:  RECTANGLE)  =FALSE] 

[FORALL-PS (SHAPE:OIAPONO)=FALSE;  [FORALL-PS (SHAPE: TRIANGLE)  =FALSE! 

[FORALL-PS  (SHAPE:  CIRCLE)  =  FALSE]  [  FORALL-PS  (SHAPE:  ELL  I  PSE)=FALSE1 
[FORALL-PS (SHAPE=USHAPE)=FALSE!  [FORALL-PS (SHAPE: POLYGON)  =FALSE] 
:F0RALL-PS(SIZE=O)=FALSE;  :foRALL-PS(SIZE  =  2):FALSE:  [FORALL-PS (TEXTURE=0)  =  FALSE! 

[“st-ontop(pd:  :ontop(pi ,P2)i  [shape(pd=«:  :shape(p2)isquare;  :size(pi)=»; 

[SIZE(P2)I0! [TEXTURE(P2):«; [ TEXTURE(P1 ) =•[ [tOIFF-SHAPE:2  31 [iDIFF-SIZE: 1  2! 

[«DIFF-TEXTUR£=1  2! (iPS(SHAPE=EXLIPSE) =0  1[ [ IPS (SHAPE=USHAPE) =0  ll 

[*PS (SHAPE: POLYGON ) =0  l] [ »PS (SHAPE:CURVED) sO : [ BPS (SHAPE:SQUARE) =0  ll 
[ IPS (SH APE: RECTANGLE) =0  1[ [iPS(SHAP£-DIA“0N0):0; [ IPS (SHAPE: TRIANGLE) =  o  1[ 

[  IPS  (SHAPE:  CIRCLE)  S3 !  [IPS  (SIZE=2)  I3[  [  IPS  (SIZE-'O)  =0  1[  [  IPS  (SIZE:  1 )  13! 

[ IPS ( TEXTURE: 1) =2  31 [IPS (TEXTUR£=0) :0  l!(iPS:2  31 


THE  FOLLOWING  EVENTS  COULD  NOT  BE  COVERED  (NONE) 


All  event i  were  covered  by 

XID 


FINDING  NE«SEEDS  The  following  table  thowe  the 


CNO-1 

EVOT  =  l 

DSUM= 

4 

2000000000000E+00 1 

values  of  sum  of  (syntactic! 

CN0=1 

EVENT=2 

DSUM= 

4 

2000000000000E-001 

distance  scores  for  each  event 

CNO=t 

EVENT=3 

DSUM= 

3 

6000000000000E+00 1 

The  distance  measure  is  a 

CNO-1 

EVENT=8 

DSUV- 

4 

OOOOOOOOOOOOOE+OO 1 

modification  of  syntactic  dis - 

CN0=2 

EVENT=4 

DSUM= 

7 

5000000000000E+00 1 

lance  described  in  Chapter  5 

CNO-2 

EVENT=4 

DSUM= 

7 

5000000000000E*00 1 

applied  to  the  attribute  values 

CN0=2 

EVENT-5 

OSUM= 

9 

2000000000000E*00 1 

generated  by  performing  tern - 

CN0=2 

EVENT =7 

DSUM= 

8 

OOOOOOOOOOOOOE+OO 1 

plate  matching  of  the  cluster 

CN0=2 

EVFJIT=8 

OSUM= 

7 

5000000000000E*00 1 

description  with  the  events 

CNO-2 

EVEN  T = 9 

OSUM= 

9 

5000000000000E*001 

Note  that  the  cluster  descrip- 

li on  matchee  event  4  in  two 
wayt  CXO  tndicatee  the  clut¬ 
ter  number  for  the  event  The 
event  in  each  clutter  with  the 
minimum  DSUSf  value  it  u ted 
at  the  teed  event  in  the  next 
iteration 


ENTER  NUMBER  OF  SEEDS  FOLLOWED  BY  THEIR  EVENT  NUMBERS 
’238 

NOW  COVERING  EVENT  3  AGAINST  8 

THE  FOLLOWING  RULES  COVER  SET  1 

THIS  RULE  COVERS  EVENTS  654321  (0  NEW) 

RULE  884  EVENT  SETS  1.  C0STS(-6-2  3)  -6-10 
iPS(TEXTURE=0)«0! 


Eventt  9  and  S  have  the 
minimum  DSUSf  tcort  (there 
i»  a  tie  between  event!  8  and 
d)  and  are  lelected  at  teedt 
for  the  next  iteration 


NOW  COVERING  EVENT  8  AGAINST  3 
THE  FOLLOWING  RULES  COVER  SET  1 
THIS  RULE  COVERS  EVENTS  987542  (0  NEW) 

RULE  899  EVENT  SETS  1.  C0STS(-6-2  3)  -8  - 1  0 
=PS<TEXTURE=1)=2  31 


EVENTS  COVERED 

1  2  3  4  5  6 
EVENTS  COVERED 

2  4  5  7  8  9 

MULT I PLY -COVERED  EVENTS 
2  4  5 

UNIQUELY  DETERMINED 
1  3  6  7  8  9 

NOW  COVERING  EVENT  3  AGAINST  987542 

THE  FOLLOWING  RULES  COVER  SET  1 

THIS  RULE  COVERS  EVENTS  631  (3  NEW) 

RULE  1139  EVENT  SETS  1.  C0STS(-8-2  3)  -3  -46  0 

:forall-ps(shafe-square)=false! ;forall-ps(shape=rectangle)=false] 

! FORALL-PS (SHAPE’ DIAMOND) ’FALSE! ;forall-ps(shape=triancle)=false] 

; forall-ps (shape=circle)=false! 'forall-ps (shape=ellipse)’Falsei 

! FORALL-PS (SHAPE’USHAPE) ’FALSE! [FORALL-PS (SHAPE’ POLYGON) ’FALSE] 

[FORALL-PS  (SHAPE’CURVED) ’FALSE]  [FORALL-PS  (SIZE’O) ’FALSE] 

; forall-ps (size=i)=falsei  [forall-ps (size=2)=false;  [forall-ps (texture’0)=false; 

'FORALL-PS (TEX TURE= l ) ’FALSE!  [LST-0NT0PIP3) ; ;MST-ONTOP (P 1 ) ! :0NT0P(P1 ,P2)’ 
:0NT0P(P2.P3); ;SAMESIZE(P1  P2)j  [SHAPE(P1)«SQUARE! [SHAPE(P2)«SQUARE! 

;SHAPE(P3) "POLYGON i ;SIZE(P1)=1! [SIZE(P2)’l! [SIZE(P3)=»] [TEXTURE(P1)=»! 
[TEXTURE(P2)”! [TEXTURE(P3)=0]  [#DIFF-SHAPE’3] [#DIFF-SIZE’2] [»DIFF-TEXTURE’2] 
(*PS(SHAPE=CIRCLE)*3!  ( »PS(SHAPE’ELLIPSE) =0  I  ][  ePS  (SHAPE’USHAPE)  =0  l! 

: «PS (SHAPE’ POLYGON ) = l  2) [*PS(SHAPE=CURVED) «0) [ «PS (SHAPE’ SQUARE) ’0! 

! ’PS (SHAPE’RECTANGLE)  =0  1  j  [’PS (SHAPE’ DIAMOND)  =0  t] [«PS(SHAPE’TRIANGLE)’0  1 ! 

;»ps(sizE’0)»3;  :»ps(size’D’2;  :»ps(size=2)=o  n  ;«psue<ture=i)  =  i! 

sPSCTEXTUR£=0)=2  3![sPS=3  4] 


» 
>  v 


HOW  COVERING  EVENT  8  AGAINST  854321 

THE  FOLLOWING  RULES  COVER  SET  1 

THIS  RULE  COVERS  EVENTS  987  (3  NEW) 

RULE  1287  EVENT  SETS  t.  COSTSC-8-2  3)  -3  -40  0 
; FORALL-PS (SHAPE- SQUARE) =FALSE] [FORALL-PS (SHAPE- RECTANGLE) ^FALSE? 
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; FORALL-PS  (SHAPED  IAPOND)  =FALSE!  [FORALL-PS (SHAPE= TRIANGLE)  =FALSE) 

: forall-ps (shape=circle)=false[ [FORALL-PS  (SHAP£=ELLIPSE)=FALSE] 

[  FORALL-PS  (SHAPE=USHAPE)=FALSE!  l FORALL-PS (SHAPE=POLYCON) =FALSE1 
:FORALL-PS (SHAPE^CURVED)  =FALSEi  [FORALL-PS (SIZE=0) =FALSE> 

[FORALL-PS  (SIZE=2)=FALSE!  [FORALL-PS(TEXTUR£=0)=FALSE!  [  FORALL-PS(  TEX  TORE- 1)  ] 
[MST-ONTOP(Pl)! :0NT0P(P1.P2)! [SAMETEXTUR(P1  P2) ] ISHAPE(PI > =POLYGON] 
[SHAPE(P2)=CURVED] [SIZE(P1)=«] [SIZE(P2)r01 [TEXTURE(Pl)=l] [TEXTUR£(P2)M) 
;«DIFF-SHAPE=2  3} [aDIFF-SIZE= l  2] [aDIFF-TEXTUREali [aPS(SHAPE=POLYGON)=l ] 
:sPS(SHAPF.=CURVED)m;  [aPS(SHAPE=SQUARE)=0  l! [aPS(SHAPE=RECTANGLE)=0  l! 

[ aPS (SHAPE=DIAMOND) =0 i [aPS(SHAPE=TRIANCLE) =0  li [aPS (SHAPE=CIRCLE) =0  lj 
>PS(SHAPE=ELLIPSE)=0  l! [rPS(SHAPE=USHAPE) =0  1] [aPS (SIZE= 1 ) 83] [aPS(SIZE=2) 83! 

[apS(SIZE-0)=0  l! [aPS(T£XTUR£=0)=0l [apS(TEXTURE=t)=2  3! [8PS;2  3] 

UNCOVERED  EVENTS  245 

NOW  COVERING  EVENT  3  ACAINST  98754 

THE  FOLLOWING  RULES  COVER  SET  1 

THIS  RULE  COVERS  EVENTS  8  3  2  1  <4  NEW) 

RULE  1434  EVENT  SETS  1.  COSTSC-8-2  3)  -4  -41  0 

[FORALL-PS  (SHAPE=SQUAR£)=FALSE!  [FORALL-PS  (SHAPE=RECTANCLE)=FALSE! 

[FORALL-PS (SHAPE=DIAMOND)=FALSE!  [FORALL-PS (shape=triangle)=false; 

[FORALL-PS (SHAFE=CIRCLE)  =FALSE]  [  FORALL-PS  (SHAPE=E1LIPS£)  =FALSE] 

[FORALL-PS  (SHAP£=USHAPE)=FALSE!  [FORALL-PS (SHAPE=POLYGON)  =FALSE] 

[  FORALL-PS  (SHAPE=  CURVED  )=  FALSE!  [FORALL-PS (SIZE=0)=FALSE! 

[FORALL-PS (SIZE=  1 )  = FALSE]  [FORALL-PS (SIZE=2)  =FALSEI  [FORALL-PS ( TEXTURES)  =  FALSE! 
[FORALL-PS(TEXTUR£=l)=FALSE[  [“ST-ONTOP(Pl)] [0NT0P(P1 . P2) ! !SAKESIZE(P1  P2) ] 

[ SHAPE (Pt)aRECTANCL£! [SHAPE(P2)«SQUARE) [S1ZECPI ) = l 1 [SIZECP2) = 1 ) ITEXTURE(P1 ) =•) 
[TEXTURE(P2)=«! [»DIFF-SHAPE=3] [S0IFF-SIZE-2! [*DIFF-TEXTURE=2] 
[*PS(SHAPE=CURVED)*0] [aPS (SHAPE-SQUARE) =0  ll [sPS(SHAPE-RECTANGLE) -0  1) 

[aPS(SHAPE=DIAM0ND)=0  li [aPS(SHAPE=TRIANGLE)=0  1] [ePS(SHAPE=CIRCLE)83i 
[aPS(SHAPE=ELLIPSE)=0  1; [aPS(SHAPE-USHAPE) =0  1 ! [aPS(SHAPE=POLYGON) = 1  2) 

[»PS(SIZE=1)=2]  [aPS(SIZE=2)=0  lj  [»PS(SIZE=0)»3)  [aPS  (TEXTURES)  =2  31 

[sPS(TEXTUR£=l ) =1 .  2] [aPS=3  4) 

NOW  COVERING  EVENT  8  ACAINST  85431 

THE  FOLLOWING  RULES  COVER  SET  1 

THIS  RULE  COVERS  EVENTS  9  8  7  2  <4  NEW) 

RULE  1580  EVENT  SETS  I,  C0STS<-8-2  3)  -4  -39  0 

[FORALL-PS (SHAPE-SQUARE) =FALSE! [FORALL-PS (SHAPE- RECTANGLE) =FALSE] 

[FORALL-PS (SHAPE^D IAPONO) =FALSE] [FORALL-PS(SHAPE=TRIANCLE) =FALSE] 

'tqraLL-PS (SHAPE=CIRCLE) =FALSEi  [ FORALL-PS (SHAPE=ELLIPSE) -FALSE! 

1RALL-PS (SHAPE=USHAPE)  =FALSEi  [FORALL-PS (SHAPE=POLYGON) -FALSE! 
GRALL-PS(SHAPE=CURVED)=FALSE[  [FORALL-PS (SIZE=0)=FALSE! 
tF0RALL-PS(SIZE=2)=FALSE!  [F0RALL-PS(TEXTURE=0)  =FALSE!  [MST-0NT0P(P1 ) ] 

[0NT0P(P1 ,P2)! [SAMETEXTUR(P1  P2)’ [SHAPECP1 ) =POLYGON) [SHAPE(P2) »SQUARE] 
;siZE(Pt)=«! [SIZE(P2)*0J  [TEXTURE(P1)=»] [TEXTURE(P2)=«! [«DIFF-SHAPE=2  3! 
[*DIFF-SIZE=I  21 [aoiFF-TEXTURE=l .  2] [«PS(SHAPE-USHAPE)=0  l! 
[aPS(SHAPE=POLYGON)=l  2! [«PS(SHAPE=CURVED)=1  2! [»PS(SHAPE=SQUARE)=0  l! 
[sPS(SHAPE=RECTANGLE)=0  t] [ePS(SHAPE=OIAMOND)=OJ [*PS (SHAPE-TRIANGLE) =0  1] 

[«PS(SHAPE-CIRCLE)»3] [ 8PS (SHAPE=ELLIPSE) =0  lj [aPS (SIZE=0) 83! [ UPS (SIZE- 1 ) *3 ] 
[»PS(SIZE=2)»3l [aPS(TEXTURE=0)«3l [»PS (TEXTURE= 1 >=2 . .3] [8PS80  lj 

NOW  COVERING  EVENT  3  AGAINST  98752 

THE  FOLLOWING  RULES  COVER  SET  1 

THIS  RULE  COVERS  EVENTS  8431  (4  NEW) 

RULE  1711  EVENT  SETS  1.  C0STS(-6-2  3)  -4  -39  0 

[FORALL-PS (SHAPE=SQUARE) =FALSE! [FORALL-PS (SHAPE=RECTANGLE) =FALSE] 

[FORALL-PS (SHAPE=D IAMOND) =FALSE] [FORALL-PS (SHAPE=  TRIANGLE) -FALSE! 

[FORALL-PS (SHAPE=CIRCLE)  =FALSE!  [FORALL-PS  (SHAPE=ELLIPSE)  =FALSE] 

[FORALL-PS (SHAPE=USHAPE)=FALSEi  [FORALL-PS (SHAFE= POLYGON )  =FALSE! 

[FORALL-PS (SIZE=0)=FALSE! [ FORALL-PS (SIZE= 1 )=FALSE] [F0RALL-PS(SIZE=2) =FALSEi 
[FORALL-PS  (TEXTURES)  =FALSE!  [FORALL-PS(TEXTURE=  1  )  =  FALSE!  :"ST-0NT0P(P1 ) ! 
[0NT0P(Pl,P2)i [SHAPE(Pl) sSQUARE] [SHAPE(P2) 8SQUARE] [SIZE(Pl)aO) [SIZE(P2)=1] 
[TEXTURE(P2)=»! [TEXTUR£(Pt)=«] [8DIFF-SHAPE=2  .3] [aDIFF-SIZE=2! t«DIFF-TEXTURE-2J 
[aPS (SHAPE-POLYGON )a3] [aPS(SHAPE=CURVED) 80] [8PS(SHAPE=SQUARE)=0] 
[aPS(SHAPE=RECTANGLE)=0  1 ] [aps(SHAPE=DIAK0ND)=0  I] [aps(SHAPE=TRIANGLE) -0  l! 
[aPS(SHAPE=CIRCL£)a3!  [aPS(SHAPE=OXIPSE)=0  1 !  [aPS (SHAPE- USHAPE)  =0  l! 

[ aPS (SIZE=0) *3] [»PS(SIZE=t)=21 [aPS(SIZE=2)=0  .1] [8PS(TEXTURE=1)=1  2] 
[aPS(TEXTURE=0)80!  [aPS  =  3  4! 
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NOW  COVERING  EVENT  8  AGAINST  8  5  3  1 

THE  FOLLOW  I NG  RULES  COVER  SET  1 

THIS  RULE  COVERS  EVENTS  98742  (5  NEW) 

RULE  1842  EVENT  SETS  1.  COSTSI-8-2  3)  -5  -37  0 

;fcrall-ps(shape=square):false] [forall-ps (shape=rectangle)=false! 
;forall-psishape=diamond)=false; [forall-ps (shape:triangle)=false) 

[rcRALL-PS (SHAPE=CIRCL£)  =FALSE]  [FORALL-PS  (SHAPE=ELLIPSE)=FALSE) 

[  FORALL-PS  (SHAPE=USHAPE)=FALSE]  [FORALL-PS  (SHAPEaPOLYCON)  aFALSE! 
[FORALL-PS(SIZE=0)aFALSE]  [FORALL-PS(SIZE=2):FALSE!  [FORALL-PS  ( TEXTURES)  =  FALSE! 
[YST-ONTOP(Pl)]  [ON TOP (PI . P2) j [ SHAPE (P 1 ) 3C I RCLE]  [  SHAPE  (P2)aSQUARE]  [SIZE(Pl):*! 
!SIZE.(P2)aO]  [TEXTURE(P2)a«!  [TEXTURE(Pt>=»]  [aDIFF-SHAPE=2  3)  [ aDIFF-SIZE:  l  2! 
[aDIFF-TEXTURE=l  2]  [«PS(SHAPE=ELLIPSE)  =0  1 1  [  «PS(SHAPE=USHAPE)  =0  1] 

: aPS (SHAPE: POLYGON ) a3 i ( aps (SHAPE=CURVED ) aO ] [ *PS (SHAPE=SQUARE) =0  1 1 

[aps(SHAPE=RFCTANGL£)=0  li  [ aPS (SHAPE=0 IAYOND)  =  0]  [8PS(SHAPE-TRIANGLE)=0  1! 

;  aPS (SHAPE-C1  CLE)  83 ]  [ aPS  (SIZE=2)  a3!  [aPS (SIZ£=0) a3]  [aPS (SIZE: 1 ) 83] 

[  aPS(  TEXTURE:  1)  =2  3] [aPS(TE0<TURE=O) 83! [ =PSaO  l! 


NOW  COVERING  EVENT  3  AGAINST  98742 

THE  FOLLOWING  RULES  COVER  SET  1 

THIS  RULE  COVERS  EVENTS  6531  (4  NEW) 

RULE  2058  EVENT  SETS  1.  C0STS<-6-2  3)  -4  -45  0 
[ FORALL-PS  (5HAPE= SQUARE)  aFALSE]  ! FORALL-  PS  (SHAPE:  RECTANGLE)  aFALSE] 

; forall-ps (shape=diamond)=false! [forall-ps (shape= triangle) =false] 

: FORALL-PS (SHAPE=CIRCL£)= FALSE] [FORALL-PS <SHAPE=ELLIPSE)=FALSE] 

: FORALL-PS (SHAPEaUSHAPE) - FALSE] [ FORALL-PS (SHAPED POLYGON) = FALSE] 

[FORALL-PS (SHAPE= CURVED) =FALSE] [FORALL-PS (SI ZE=0) =FALSE] 

[FORALL-PS (SIZE: 1)=FALS£]  [FORALL-PS (SIZE: 2)  =  FALSE]  [FORALL-PS (TEXTL’RE“0)  =  FALSE] 
:F0RALL-PS(TEXTURE=1)=FALSE: [LST-0NT0P(P3)] [MST-ONTOP(Pl)] [ ONTOP (P 1 , P2) ] 

[ONTOP (P2 . P3) ] [SHAPE (PI ) a SQUARE] [SHAPE(P2) aSQUARE] [SHAPE(P3)aP0LYG0Nj 
[SI7.E(Pl)aO]  [SIZE(P2)  =  t]  [SIZE(P3)=«]  [ TEXTURE(P3) =• i  [  TEXTURE(P  1 )  :  •  ] 

[ TEXTURE(P2) =  •  ] [aDIFF-SHAPE=3] [30IFF-SIZE:2] [:DIFF-TEXTURE=2] 

[ aPS (SHAPE=TRIANGLE) =0  t] ! aPS (SHAP£=CIRCLE) 83] [ aps (SHAPE: ELLIPSE) -0  ij 
[aps (SHAPE=USHAPE) =0  1] [aPS (SHAPE: POLYGON) a 1  2[ [aps (SHAPE: CURVED )ao] 

[ aPS (SHAPE^SQUARE) =0] [ aps (SHAPE=RECTANGLE) =0  1] [ aPS (SHAPE=D I AMOND) =0  1 

[aPS(SIZE=2)83] [aPS(SIZEaO)83] [aPS(SIZEa 1 ) = 1  2] 'aps(TEXTURE:0)ao] 

[aps (TEXTURE: I) a l  2] [aPS=3  4] 


NOW  COVERING  EVENT  8  AGAINST  8  3  1 

THE  FOLLOWING  RULES  COVER  SET  1 

THIS  RULE  COVERS  EVENTS  987542  (8  NEW) 

RULE  2192  EVENT  SETS  1.  C0STS(-8-2  3)  -6  -37  0 

[FORALL-PS (SHAPE: SQUARE) =FALSE] [FORALL-PS (SHAPE= RECTANGLE) =FALSE] 

[FORALL-PS (SHAPE=0IAYCND)=FALSE; [FORALL-PS (SHAPE: TRIANGLE) :FALSE[ 
[FORALL-PS(SHAPE=CIRCLE)=FALSE] [FORALL-PS(SHAPE=ELLIPSE) =FALSE[ 

[FORALL-PS (SHAPE=USHAPE) =FALSE] [FORALL-PS (SHAPE: POLYGON) -FALSE] 

[FORALL-PS (SIZE=0) = FALSE] [F0RALL-PS(SIZE:2)=FALSE! [FORALL-PS ( TEXTURE  0):FALCE[ 
[YST-ONTOP(Pl) ] [ONTOP(P1 ,P2)! [SHAPE(P 1 ) =• ] [SHAPE (P2) aSQUARE] [SIZE(P1):« 
[SIZE(P2)ao] [TEXTURE(P2)=*i [ TEXTURE(Pl ) :♦ i [aoIFF-SHAPE:2  3i [aDIFF-SIZE= 1  2] 

[*D IFF- TEXTURE: 1  2! [aPS(SHAPE=ELLIPSE) =0  1 ] [aps(SHAPE=USHAPE) =0  1] 

[8PS(SHAPE=P0LYG0N)a3] [ aPS (SHAPE=CURVED) ao] [apS(SHAPE:SQUARE):0  1] 

[ aps (SHAPEaRECTANGLE) =0  1] [aps (SHAPE= DIAMOND) =0] [8PS (SHAPE: TRIANGLE) =0  1] 

[aPS (SHAPE: CIRCLE) «3J [aPS(SIZE=2) 83] (8PS(SIZE=0)a3] [8PS(SIZE= I ) S3] 

[aps (TEXTURE: I ):2  3] [8PS(TEXTURE=0)S3] [aPSaO  I] 


RULE  COVERING  CLUSTER  1  (EVENTS  831) 

RULE  1139  EVENT  SETS  1.  C0STS(-8-2  3)  -3  -48  0 
[FORALL-PS (SHAPE=SQUAR£) =FALSE! [FORALL-PS (SHAPE= RECTANGLE) =FALSE] 
[FORALL-PS  (SHAPE=DIAKOND)  =FALSE]  [FORALL- PS  (SHAPE:  TRIANGLE)  aFALSE] 
[FORALL-PS (SHAPE=CIRCL£)=FALSEj  [FORALL-PS (SHAPE: ELLIPSE)  =FALSE] 
[FORALL-PS  (SHAPE=USHAPE)  aFALSE]  [FORALL-PS  (SHAPE=POLYGON )  =FALSE] 
[FORALL-PS (SHAPE=CURVED) aFALSE] [FORALL-PS C5IZE=0) aFALSE] 


The  retailing  clutter  detenp- 
lion*  are  given  here  There 
de  tcnptiont,  edited  to  reveal 
the  detenptort  which  ditcnm- 
mate  between  clatter,  are 
given  in  Fig  6  5  flower 
figure/ 


[FORALL-PS  (SIZE=1)  aFALSE]  [F0RALL-PS(SIZE  =  2)=FALSE]  [FORALL-PS  (  TEXTURES)  =FALSE] 
[FORALL-PS (TEXTURE: 1) aFALSE] [LST-0NT0P(P3) ! [“ST-ONTOP(Pl) ] [0NT0P(P1 ,P2)[ 

[ONTOP (P2.P3)i [SAYESIZE(P1  P2)] [SHAPE(P1 ) aSQUARE] [SHAPE(P2) aSQUARE] 

[ SHAPE (P3 ) SPOLYGON] [SIZE(Pt)al' 'SIZE(P2)=1] [SIZE(P3)aa] [ TEXTURE(P1 ) =•! 
[TEXTURE(P2)=*j  [TEXTURE (P3) =0] [aOIFF-SHAPE:3] [ aDIFP-SIZE=2] [ a D IFF -TEXTURE: 2] 
[aPS(SHAPE:CIRCLE)83] [ 8PS(SHAPE= ELL IPSE) =0  1] [8PS(SKAPE=USHAPE):0  t! 

[ aPS (SHAPE=POLYGON ) = 1  2] [ aps (SHAPEaCURVED ) ao ] [aPS(SHAPE=SQUARE) =0] 

[aps (SHAPE= RECTANGLE) =0  1 ] [ePS(SHAPE=DIAY0ND):0  1] [aPS(SHAPEaTRIANGLE) =0  1] 


>PS(SIZE=0)*3:  :*PS(SIZE=1)=2;  :»PS(SIZE=2)=0  t:  »PS(TEXTURE=l)  =  i: 
:«PS(TEXTURE=0)-2  3; :»PS=3  4! 


RULE  COVERING  CLUSTER  2  (EVENTS  9  8  7  S  4  2) 

RULE  2192  EVENT  SETS  1.  C0STS(-8-2  3)  -8  -37  0 
[ FORALL-PS (SHAPE=SQUAR£)=FALSE!  [FORALL-PS  (SHAP£=RECTANGLE)=FALSE) 

[FORALL-PS  £SHAP£=DIAMOND)=FALSEl [forall-ps (shape=triangle)=false: 

[FORALL-PS  (SHAPE=CIRCLE)=FALSEl  [FORALL-PS (SHAPE=E3-LIPSE)  =FALSE] 

[  FORALL-PS  (SHAPE=USHAPE)=FALSE!  [FORALL-PS (SHAP£= POLYGON )=FALSE] 
;F0RALL-PS(SIZE=0)=FALSE;  [FORALL-PS(SIZE=2)=FALSE]  [FORALL-PS (TEXTURE=0)=FALSEi 
[MST-ONTOP (PI) ! [ONTOP (P I , P2) j  [SHAPE (F l> =•] [SHAPE(P2) SSQUAREj [SIZE(P1)=»] 
;siZE(P2)#0]  [TEXTURE(P2)  =  »!  [TEXTURE(Pl)=*i  [»DIFF-SHAPE=2  3]  I*DIFF-SIZE= 1  2) 

[sDIFF-TED(TUR£=  1  2]  >PS(SHAPE=ELLIPSE)=0  1 ] [SPS(SHAPE=USHAPE> =0  1] 

[#PS(SHAPE=P0LYG0N)«3] [sPS(SHAPE=CURVED)«Ol ;»PS(SHAPE=SQUARE) -0  1} 

:jPS(SHAPE=RECTANGLE)=0  t: [»PS(SHAPE=DIAM0ND)=01 [«PS(SHAPE=TRIANGLE)=0  1; 
;*PS(SHAPE=CIRCLE)«3; [ «PS (SIZE-2) 431 [«PS (SIZE=0) «3) [#PS(SIZE=1)»3] 

[  IPS  ( TED£TURE=  1 )  =2  3)  [  IPS  (TEXTURES)  13]  [  «PS»0  1] 

THE  FOLLOWING  EVENTS  COULD  NOT  BE  COVERED:  (NONE) 

FINDING  NEUSEEDS 


CNO-t 

EVEAT=t 

OSUH= 

5 

2000000000000E+  00 1 

CMO-  t 

EVEMT=3 

DSUM= 

4 

OOOOOOOOOOOOOE+OO 1 

CNO-1 

EVEJIT=« 

DSUM= 

3 

9000000000000E+00 1 

CNO=  1 

EVEKT=0 

OSUM= 

3 

9000000000000E+ 00 1 

CN0=2 

EVENT=2 

DSUM= 

1 

I 200000000000E*002 

CN0=2 

EVEMT=4 

DSUM= 

9 

3000000000000E+00 1 

CM0=2 

EVENT=4 

DSUM= 

9 

3000000000000E*00 1 

CN0=2 

EVE«T=5 

DSTJM- 

t 

1200000000000E-002 

CM0=2 

EVEMT=7 

DSU*= 

9 

7  OOOOOOOOOOOOE  *  00 1 

CM0=2 

EVENT=8 

DSU^= 

9 

3000000000000E*00 1 

CN  0=2 

EVENT=9 

1 

: ooooooooooooe • 002 

ENTER  NUMBER  OF  SEEDS  FOLLOWED  BY  THEIR  EVENT  NUMBERS 
7  2  8  4 

NOW  COVERING  EVENT  6  AGAINST  4 
THE  FOLLOWING  RULES  COVER  SET  1 
THIS  RULE  COVERS  EVENTS  8  3  2  1  (0  NEW) 

RULE  2212  EVENT  SETS  1.  C0STS(-S-2  3)  -4  -10 
;=PS(TEXTURE=0)=2  3! 

NOW  COVERING  EVENT  4  AGAINST  8 
THE  FOLLOWING  RULES  COVER  SET  1 
THIS  RULE  COVERS  EVENTS  98754321  (0  NEW) 

RULE  2233  EVENT  SETS  1.  C0STS(-8-2  3)  -8-10 
[sPS(TEXTURE=0)i3] 

EVENTS  COVERED 
12  3  8 

EVENTS  COVERED 
1  2  3  4  5  7  8  9 
MULTIPLY -COVERED  EVENTS 
1  2  3 

UNIQUELY  DETERMINED 
4  5  8  7  8  9 

NOW  COVERING  EVENT  8  AGAINST  98754321 
THE  FOLLOWING  RULES  COVER  SET  1 
THIS  RULE  COVERS  EVENTS  8  (1  NEW) 

RULE  2573  EVENT  SETS  1.  COSTS (-8-2  3)  -1  -54  0 

;forall-ps(shape=square)=false: ;forall-fs(shape=rectangle)=false; 

; forall-ps (shape=diamond)=false; : forall-ps (shape= triancle) =false; 
;forall-ps(shape=circle)=false; :forall-ps(shape=ellipse)=falsei 

: FORALL-PS  (SHAPE=USHAPE)  =FALSE[  FORALL-PS  (SHAPE'  POLYGON )  =FALSE1 

; forall-ps (shaped  curved) =false; [forall-ps (size=o>=false: 
forai_l-ps(size-d=false;  :forall-ps(size=2) -false:  :forall-ps(tdcture-o)=false: 

;fORALL-PS(TEXTURE=1)=FALSE: ;lST-0NT0P(P3): [LST-0NT0P(P4)[ :“ST-0NT0P(P1)1 
:ontop(pi  P2);  ;oNTOPfP2.P4): ;ontop(p2.p3); :sameshape(P3  P4>: :samesize(p3  P4>: 
;SAMESIZE(P1  P2)’ ;SAMETEXTUR(P2  P3  P4) : [ SHAPE(Pl ) ^ELLIPSE! :SHAPE(P2) ^RECTANGLE: 

:shapecp3)=circle; :shape(P4)=circle: ;size(pi)=i: ;size(P2)-i;  ;size(P3)=o] 


The  nett  ehotet  0/  teed  event t 
it  event*  6  and  4 


NtD  mat  able  to  cover  oil 
eventi 
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SIZE(P4)30! [TEXTURE(P4)30! [TEXTURE (Pl)=l ' [ TEXTURE CP2) =01 ! TEXTURE (P3) =0! 

! aD IFF -SHAPE- 3! 1 aDIFF-SIZE32! [aDIFF-TEXTURE32! [ 3 PS (SHAPE3 TRIANGLE) =0] 

‘ a PS (SHAPE3 CIRCLE) =2] [aPS(SHAPE3ELLIPSE)  3  i :  [ePS(SHAPE3USHAPE)30] 

! aPS (SHAPE3P0LYC0N) =  1 1 [BPS (SHAPE3  CURVED) =3] [bPS(SHAPE3SQUARE)30] 
[3PS(SHAPE3RECTANCLE)3t!  [bPS(SHAPE3DIAMON0)3O!  [aPS(SIZE32)=0]  [ BPS (SIZE=0)  =2] 
:»PS(SIZEM)=2;  [aPS(TEXTUR£3l)3U  [aPS(TEXTURE30)33!  [aPS34] 

ROW  COVERING  EVERT  4  AGAINST  8321 

THE  FOLLOWING  RULES  COVER  SET  1 

THIS  RULE  COVERS  EVERTS  98754  (5  NEW) 

RULE  2697  EVERT  SETS  1.  COSTS (-6-2  3)  -3  -37  0 
[FORALL-PS(SHAPE3SQUARE)3FALSEI  [FORALL-PS (SHAPE3 RECTANGLE) =FALSE] 

FORALL-PS (SHAPE= DIAMOND)  =FALSE!  [ FORALL-PS  (SHAPE3 TRIANCL£)3FALSE! 

[ FORALL-PS (SHAPE3CIRCL£)=FALSE! [ FORALL-PS (SHAPE3ELLIPSE)3FALSEl 
: FORALL- PS (SHAPE=USHAPE) =FALSE]  [ FORALL-PS (SHAPE3  POLYGON ) =FALSE] 
:foRALL-PS(SIZE=0)=FALSE:  [F0RALL-PS(SIZE  =  2)=FALSE!  [F0RALL-PS(TEXTUAE30)3FALSE1 
[MST-ONTOP(Pl)! [0NT0P(P1 ,P2)’ [SHAPE(Pl)3»j [SHAPE(P2)  8SQUARE] [SIZE(P1)3»! 
[SIZE(P2)a0] [TEXTUR£(P2)=«! [  TEXTURE  (Pl)3«l [bOIFF-SHAPE32  3] [aDIFF-SIZE3 1  2] 

[aDIFF-TEXTUAEM  2]  [BPS (SHAPE3E1LIPSE)  =0  l! [aPS(SHAPE3USHAPE)30  1] 
[aPS(SHAPE=P0LYG0N)30  1 ] [aPS(SHAPE3CURVED) BOj ! BPS (SHAPE3  SQUARE) =0  1) 

[aPS(SHAPE3R£CTANCL£)30  I] [aPS (SHAPE3 DIAMOND) =0] [  BPS (SHAPE3 TRIANGLE) =0  1] 

;*PS(SHAPE=CIRCLE)«3] [BPS(SIZE32)B3] [«PS(SIZE=0)=0  1] [*PS(SIZE=1)«3] 

[ BPS ( TEXTURE3 1) =2  3] (»PS(TEXTURE=0)=0  1][BPS32  3) 

UNCOVERED  EVENTS  I  2  3 

NOW  COVERING  EVERT  6  AGAINST  9875432 
THE  FOLLOWING  RULES  COVER  SET  1 
THIS  RULE  COVERS  EVERTS  8  1  (2  NEW) 

RULE  2934  EVERT  SETS  t.  C0STS(-6-2  3)  -2  -48  0 

; FORALL-PS <SHAPE3SQUARE)  =FALSE]  [FORALL-PS (SHAPE-RECTANGLE)  =FALSE] 

[FORALL-PS (SHAPE=OIAMOND)  =  FALSE:  [FORALL-PS(SHAPE3  TRIANGLE)  3FALSE] 
r  FORALL-PS  (SHAPE3CIRCLE)3FALSE1  [FORALL-PS  (SHAPE=ELLIPSE)  3FALSE] 

[FORALL-PS (SHAPE=USHAPE)=FALSE;  [  FORALL-PS  (SHAPE3POLYG0N  )  =  FALSE] 

[FORALL-PS (SHAPE- CURVED ) 3  F ALSE !  [FORALL-PS  (S  IZE=0)  =FALSE] 

[FORALL-PS  (SIZE3  t )  =FALSE]  [FORALL-PS  (SIZE=2)  =FALSE!  [FORALL-PS  (TEXTUR£=0)  =FALSE] 
[FOAALL-PS  (TEXTURE3 1  )=FALSE1  (LST-0NTQPCP3)  [  [MST-ONTQPCPl) !  [0*T0P(P1 ,P2)1 
[ONTOP (P2 . P3) ] [3AMESIZE(P1  P2)l [SHAPECPl ) aSQUARE! ISHAPE(P2) aSQUARE! 

[SHAPE(P3) apOLYGON] [SIZE(Pl)3l] [SIZE(P2)=l] !SIZE(P3)=»! [TEXTURE(P1  >  =•) 

[ TEXTURE(P2) 3* 1 [TEXTURE(P3) =0] [a0IFF-SHAPE=3] [ aDIFF-SIZE32! [ »DIFF-TEXTURE-2] 

[  aps  (SHAPE-CIRCLE)  3  l  21  [aPS (SHAPE' ELL IPSE)  =0  1 ! [aPS(SHAPE3USHAPE> 30  ll 

[aPS(SHAPE=POLYGON)  =  lj  [ BPS (SHAPE=CURVED ) B0[  [  «PS(SHAPE=S(JUARE)  =0! 

[ aPS (SHAPE-RECTANGLE) =0  1] [aPS(SHAPE-DIAM0ND)=0  ll [ «PS(SHAPE= TRIANGLE) =0 ! 

[aPS(SIZE=0)a31  [aPS(SIZE=  1 )  =2]  [aPS(SIZE=2)  =0  ll  [  aPSdEXTURE3 1  )  =  1 1 
[ BPS ( TEXTURE- 0)  =2  3) [aPS=3  41 

NOW  COVERING  EVERT  4  AGAINST  832 

THE  FOLLOWING  RULES  COVER  SET  1 

THIS  RULE  COVERS  EVERTS  9  8  7  5  4  1  (8  NEW) 

RULE  3088  EVERT  SETS  1.  C0STS(-8-2  3)  -8  -37  0 

[FORALL-PS  (SHAPE3SQUARE)  =FALS£]  [FORALL-PS  (SHAPE-RECTANGLE)  -  FALSE! 

[FORAJLL-PS  (5HAPE3DIAM0ND)  3FALSE!  [FORALL- PS  (SHAPE3  TRIANGLE)  3  FALSE] 

[FORALL-PS  (SHAPE3CIRCLE)3FALSE1  [FORALL-PS(SHAPE3ELLIPSE)3FALSE] 

[  FORALL-PS  (SHAPE3USHAPE)3FALSE]  [FORALL- PS(SH‘PE-POLYGON)3FALSEI 
[FORALL-PS (SIZE30)3FALSE:  [F0RALL-PS(SIZE=2)  3FALSE1  [FORALL-PS  (TEXTURE30)  3FALSE[ 
[MST-ONTOP(Pl): [0NT0P(P1 , P2 ) ] [SHAPE(P1 ) =•] [SHAPE(P2) aSQUARE! [SIZE(P1)3»] 
[SIZE(P2)ao;  [ TEXTURE(P2)  =•]  [ TEXTURE(P1 ) --•  [  [aD IFF- SHAPE3 2  3!  [ aDIFF-SIZE3 1  2! 

[ao IFF- TEXTURE3 1  2]  [aPS(SHAPE3ELLIPSE)  =0  1  [  [  apS(SHAPE3USHAPE)  =0  1[ 

[ aPS (SHAPE3 POLYGON ) =0  1 1 [ sPS (SHAPE=CURVED) BO' [ aPS (SHAPE=SQUARE) 30  l! 

[ aPS (SHAPE3 RECTANGLE) 30  1 1 [apS(SHAPE3OIAMOND) -0  t 1 [aps (SHAPE- TRIANGLE) 30  1[ 

[aps( SHAPE3 CIRCLE)a3] [BPS(SIZE32)a3] [BPS(SIZE30)30  t[ [ aps(SIZE3 1 ) »3] 

[ BPS ( TEXTURE3 1) BO!  [aPS(TEXTURE30)B3)  [aPS32  31 

NOW  COVERING  EVERT  8  AGAINST  9875431 
THE  FOLLOWING  RULES  COVER  SET  l 
THIS  RULE  COVERS  EVERTS  8  2  (2  NEW) 

RULE  3212  EVERT  SETS  1.  C0STS(-8-2  3)  -2  -41  0 

[FORALL-PS  (SHAPE3SQUARE)=FALSE1  [FORALL-PS  (SHAPE=RECTANGLE)  3FALSE! 

[  FORALL-PS  (SHAPE3  DIAMOND)  =FALSE1  [FORALL  -  PS  (SHAPE3  TRIANGLE) 3  FALSE! 

[FORALL-PS (SHAPE3CIRCLE)3FALSE;  ;F0RALL-PS(3HAPE3EU.IPSE)3FALSE: 
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[forall-ps(shape=ushape)=false:  :forall-ps<shape=polygon)=false; 
:forall-ps(shape-curved)=false: ;forall-ps(SIZe=o)=false; 

[F0RALL-PS(SIZE=1)=FALSE!  [FORALL-PS (SIZ£=2)=FALSE!  [  FORALL-PS  (TD(TURE30)=FALSE) 
[FORALL-PSCTEXTUREM^FALSE!  [MST-ONTOP(Pl)!  [0NT0P(P1.P2)!  [SAKESIZE(Pl  P2)l 
[SHAPE(P1)*RECTAHGLE! ISHAPE(P2)=RECTANGL£!  rSIZE(Pl)=t; [SIZE(P2)=l! 
[TEXTURE(P1)=«! [TD(TURE(P2) =0] [#DIFF-SHAPE=3l [ sOIFF-SIZE=2i [»DIFF-TEXTURE=2! 

[ 3  PS (SHAPE=CURVED) =2  3) [*PS(SHAPE=SQUARE) =0  1 ! [*PS (SHAPE=  RECTANGLE) = t ; 

[sPS(SHAPE=DIA.Y0ND)=01  [sPS(SHAPE=TRIANGLE)=01  [sPS  (SHAPE=CIRCLE)  =2! 
[sPS(SHAPE3iO-LIPSE)=0  1]  [sPS(SHAPE=USHAPE)=0!  [sPS(SHAPE=POLYGON)=l  2! 
[*PS(.SIZE=1>=2]  [sPS(SIZE=2)=0]  [*PS(SIZE=0)=21  [*PS(TEXTURE=0)=2  3] 

[  sPS (TEXTUR£= 1 )  =  1  2]  i»PS=4] 

ROW  COVERING  EVENT  4  AGAINST  8  3 

THE  FOLLOWING  RULES  COVER  SET  1 

THIS  RULE  COVERS  EVENTS  98754321  (7  HEW) 

RULE  3342  EVENT  SETS  1.  COSTSC-6-2  3)  -7  -37  1 

[FORALL-PS (SHAPE=SQUARE)  =  FALS£i  IFORALL-PS (SHAPE=  RECTANGLE)  =FALSE’ 

[FORALL-PS (SHAPE=D IAMOND) =FALSEl  [FORALL-PS  (SHAPE=TRIANGLE)  =  FALSE] 
[FORALL-PS(SHAPE=CIRCLE)=FALS£i  [FORALL-PS (SHAPE=ELL IPSE)  =FALSE! 

[FORALL-PS (SHAPE-USHAPE)  -FALSE!  [FORALL-PS  (SHAPE= POLYGON)  =FALSE] 

[FORALL-PS  (SIZE-0) -FALSE]  [F0RALL-PS(SIZE=2)=FALSE!  [FORALL-PS (TEC  TURE-O)  -FALSE! 
[MST-ONTOP (PI)] [0NT0PCP1 ,P2) ] [SHAPE(P1)=«I [SHAPE(P2)«SQUAREI [SIZE(Pl)-»] 
[SIZE(P2)*0I [TEXTURE(P2)=«] [TEXTURE(P1)=«1 [ *DIFF-SHAPE=2  3] [sDIFF-SIZE- 1  2) 

[SDIFF-TEXTURE-1  21 [sPS (SHAPE-ELLIPSE) -0  l !! SPS (SHAPE-USHAPE) =0  l’ 

[ SPS (SHAPE- POLYGON ) *3 ] [sPS(SHAPE-CURVED)sO! [SPS (SHAPE-SBUARE) =0  11 

[sPS (SHAPE-RECTANGLE) =0  ll [sPS(SHAPE=DIAMON0)=O  l! [SPS(SHAPE-TRIANCLE)=0  11 
[sPS (SHAPE-CIRCLE) S3) [ sPS (SIZE-2) S3! [sPS(SIZE-0)*3] [sPS(SIZE=l)s3! 
[3PS(TEXTURE=O*01  [«PS(TEXTURE=0)*3!  [sPSsO  l! 

ROW  COVERING  EVENT  8  AGAINST  9873421 
THE  FOLLOWING  RULES  COVER  SET  1 
THIS  RULE  COVERS  EVENTS  8  3  (2  NEW) 

RULE  3579  EVENT  SETS  1.  COSTSI-8-2  3)  -2  -46  0 

;forall-ps(shape-square) -false! [forall-ps(shape-rectancle) -false; 

FORALL-PS(SHAPE-DIAKOND) -FALSE]  (FORALL- PS  (SHAPE- TRIANGLE) -FALSE! 

[FORALL-PS (SHAPE-CIRCLE) -FALSE! [FORALL-PS (SHAPE-ELLIPSE) -FALSE! 

[ FORALL - PS (SH APE-USH APE) = FALSE! [ FORALL - PS ( SHAPE-  POLYGON ) -FALSE! 

[FORALL-PS  (SH APE- CURVED)  -FALSE!  [FORALL-PS  (SIZE-0) -FALSE) 

[FORALL-PS (SIZE- l )  -FALSE!  [FORALL-PS (SIZE-2) -FALSE!  [FORALL-PS  (TEXTURE-0) -FALSE! 
[FORALL-PS  (TEXTURE- t) -FALSE! ILST-0NT0P(P3) ! [ «ST-0NT0P(Pt ) ] [ORTOPtPl . P2) 1 
[0NT0P(P2.P3) [ [SAMESIZECP1  P2)j [SHAPEtPl ) *SQUARE1 [SHAPECP2) -RECTANGLE) 
[SHAPECP3) =CURVED ] [SIZE(P1)-1] [SIZE(P2)-l! [SIZE(P3)=»’ [TEXTURE(Pl)-*! 
[TEXTURE(P2)-«! [TEXTURE(P3)=0! [*DIFF-SHAPE-3[ [ «DIFF-SIZE-2! :»DIFF-TEXTURE=2! 
[»PS (SHAPE-CIRCLE) *3! [*PS (SHAPE-ELLIPSE) = 1 [ [ 3PS (SHAPE-USHAPE) =0! 
[sPSCSHAPE-POLYGON)-!  21 [jPS(SHAPE-CURVED)«OI [3PS(SHAPE=SSUARE) -0! 
[«PS(SHAPE=RECTARGLE)=l! [sPSCSHAPE-OIAYCNO) =0! [ »PS (SHAPE-TRIANGLE) =0  l! 
[aPS(SIZE=0)33! [*PS(SIZE=1)=2! [3PS(SIZE-2) =0  l[ [*PS (TEXTURE- 1 )  - 1 ! 

[ -PS (TEXTURE-0) =2.  31 [-PS-3  4! 

NOW  COVERING  EVENT  4  AGAINST  8 

THE  FOLLOWING  RULES  COVER  SET  1 

THIS  RULE  COVERS  EVENTS  98754321  (8  HEW) 

RULE  3711  EVENT  SETS  1.  C0STS(-S-2  3)  -8  -37  0 

[forall-ps (shape-square) -false: [forall-ps (shape- rectangle) -false: 
:forall-ps(shape=diayond) -false: !FORALL-PS(SHAPE=TRIANCLE) -FALSE! 

[FORALL-PS (SHAPE-CIRCLE)  -FALSE!  [FORALL-PS  (SHAPE- ELLIPSE) -FALSE! 
[FORALL-PS(SHAPE-USHAPE) -FALSE! [FORALL  PS(SHAPE-POLYGON) -FALSE! 

[FORALL-PS  (SIZE-0) -FALSE! [FORALL -PS (SIZE -2) -FALSE; [ FORALL-PS (TEXTURE-0) -FALSE! 
[uST-ONTOP (PI ) ! [0NT0P(P1  P2) ■ [SHAPE(P1 ) -•! [SHAPE(P2) »SQUARE, [SIZE(P1)=»! 
[SIZE(P2)*01  [TEXTURE(P2>-«!  [TEXTURE(Pl) -•!  [  4DIFF-SHAPE-2  31  [  sDIFF-S IZE-  1  21 

[-DIFF-TEXTURE-1  2!  [«PS (SHAPE-ELL IPSE) =0  1  [ »PS (SHAPE-USHAPE) =0  1[ 

[ s PS (SHAPE -POLYGON ) *3 [ [ «PS (SHAPE-CURVED) «0 1 !«PS(SHAPE=S(JUAR£) -0  ![ 

[ *PS (SHAPE- RECTANGLE) =0  1 [ [«PS(SHAPE=OIAPOND) =  0  1 ’ ;»PS(SHAPE=TRIANCLE) =0  l[ 

[»PS(SHAPE=CIRCL£)«3i  [«PS (SIZE-2) «3!  [«PS(SIZE-0>*3!  [>PS(SIZE= 1 ) »3i 
[*PS( TEXTURE- 1)*0! [«PS(TEXTURE=0)«3i [sPSsO  1[ 

RULE  COVERING  CLUSTER  1  (EVENTS  8) 

RULE  2373  EVENT  SETS  1.  C0STS(-6-2  3)  -1  -54  0 
!FCRALL-PS(SHAPE=S5UARE) -FALSE!  [FORALL-PS  (SHAPE-RECTANGLE) -FALSE! 


.FORALL-PS (SHAPE-D l AMOND) -FALSE] [ FORALL- PS (SHAPE- TRIANGLE) -FALSE] 

.  FOrtALL  PS  (SHAPE-CIRCLE)  -FALSE'  [FORALL- PS (SHAPE- ELL IPSE)  -FALSE] 

FORALL -PS (SHAPE-USHAPE) -FALSE] 'FORALL- PS (SHAPE- POLYGON) -FALSE] 

FORALL  -  PS (SHAPE- CURVED ) -FALSE] [ FORALL- PS (SILE-O) -FALSE] 

; furall-ps (size-  i )  -false:  [FORALL-PS (SIZE=2)  -FALSE]  [FORALL-PS (TEXTURE-O)  -FALSE] 

; FORALL- PS (TEXTURE- 1) -FALSE]  [LST-ONTOP(P3)]  (LST-ONTOP CP4 )  j  [MST-ONTOPCP1)] 
[0N70P(P1 , P2) ] [0NT0P(P2.P4)] [GNTOP (P2 , P3) ] [SAMESHAPE(P3  P4)] (SAMESIZE(P3  P4) ] 
[SAMESIZE(Pl  P2)j  [SAMETEXTUR (P2  P3  P4)  ]  'SHAPE(Pl)  -ELLIPSE]  [ SHAPE (P2 )=  RECTANGLE! 
[SHAPE(P3) -CIRCLE] [SHAPE(P4) -CIRCLE; [SIZE(P1)-1] [SIZE(P2) = 1 ] [SIZE(P3) =0] 
;SILE(P4)=0J  [ TEXTURE (P4)-0] • TEXTURE (PI )= 1 ] [TEXTURE(P2) =0] ( TEXTURE (P3)=0] 

;  *0 IFF - SHAPE- 3 j  ;  aOIFF-SIZE-2;  [»D IFF- TEXTURE-2]  [ «PS  (SHAPE-TRIANGLE)  =0 ] 
sPS (SHAPE- CIRCLE) =2] [ sPS (SHAPE=ELLIPSE) = 1 ] [ «PS (SHAPE-USHAPE) =0 ! 

[  3 PS ( SHAPE- POLYGON ) =  1 ]  [a PS (SHAPE-CURVED) =3]  [ aPS (SHAPE-SQUARE) =0] 

[ aPS (SHAPE- RECTANGLE) = 1 ] 'aPS(SHAPE-DIAMOND) =0] [ #PS (SIZE-2) =0 ] [ aPS (SIZE-0) -2 J 
[aPS(SIZE=l)=2! [aPS( TEXTURE- l)=l]  (apS( TEXTURE- 0) =3] [aPS-4] 


RULE  COVERING  CLUSTER  2  (EVENTS  98754321) 

RULE  3711  EVENT  SETS  1.  COSTSC-6-2  3)  -8  -37  0 
: FORALL- PS (SHAPE-SQUARE) -FALSE] [FORALL-PS (SHAPE" RECTANGLE) -FALSE] 

' FORALL-PS (SHAPE-DIAMOND) -FALSE]  [FORALL-PS (SHAPE-  TRIANGLE) -FALSE] 

[  FORALL-PS  (SHAPE-CIRCLE)  -FALSE]  [FORALL  PS  (SHAPE- ELL  IPSE)  -FALSE] 

[FORALL-PS (SHAPE-USHAPE) -FALSE] [FORALL-PS (SHAPE-POLYGON) -FALSE] 

[FORALL-PS (SIZE-0) -FALSE! [FORALL-PS (SIZE-2) -FALSE] [FORALL-PS (TEXTURE-0) -FALSE] 
[ MST-ONTOP (PI ) ] [0NT0P(P1 ,P2)] [SHAPE(P1 ) =• ] ( SHAPE ( P2 ) aSQUARE] (SIZE(Pl)-*] 
[SIZE(P2)»o; [ TEXTURE (P2)-*]  [ TE<TURE(Pl ) =• ] [ *D IFF-SHAPE-2  3] [aDIFF-SIZE- l  21 
[sD IFF- TEXTURE- 1  2] [ aPS (SHAPE-ELLIPSE) -0  1  ][  #PS  (SHAPE-USHAPE) -0  1] 

>PS (SHAPE-POLYGON) *3] [  aPS (SHAPE-CURVED) «0 [ [ a PS (SHAPE- SQUARE) -0  1] 

[sPS (SHAPE- RECTANGLE) =0  1 [[ #PS (SHAPE-D IAMOND) -0  1 ][ aPS (SHAPE- TRIANGLE) -0  1] 

[ aPS (SHAPE-CIRCLE) «3] [sPS (SIZE-2) #3] [«PS (SIZE-0) a3] [aPS(SIZE= 1 ) s3] 

[ aPS ( TEXTURE- 1 )  CO  j  [aPS (TEXTURE-0) 33 1  [aPSsO  i[ 
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stopping  criterion 

ENTER  ONE  CHAR  <P) ARA. METERS .  (V)L1.  (C)OVER,  (M)ODIFY.  (H)ELP  FOR  OPTIONS 

?  q 

CPU  TIME  USED  169  321  SEC 


TABLE  OF  PROCEDURE  USE  COUNTS 


352-ALLC 
0- ADDCONS 
31 4-ADDLINK 
28-CCOVER 
O-CALCARITH 
3779-FREEGRPH 
O-LSCHOOSE 
5001 -NEVC 
3850-C0PYCPX 
29462-SUBG 
28-TRIMM 
1 1074  - CPXCOV 


50- AQ 

28 l - ABSOURB 
1978-COSTC 
8365-COSTG 
896-COMPMS 
4900-FREECPX 
28-ADDMETA 
3789- NE-G 
3850-C0PYGRPH 
I44-TRIMC 
8 10- TOOSMALL 
383-GEN RLIZ 


72-AQSET 

0  applrules 

O-CLEANCPX 

28-COVER 

790-DCTND 

O-SUBGDETAIL 

72-ADDTOMQ 

810-NEiGP 

O-PROCARITH 

253-TRIMG 

O-VLl 


9-ADDSEL 
O-ADDLRULES 
3 -CLUSTER 
O-COSTL 
10084-FREETAB 
92-LQST2 
444-NEVCPXTAB 
3-NEVSEEDS 
62268-SUBG1 
O-TRIML 
1 1-VLINT 


SG-A  LRULE  CPXTB 

1  0  10 
10 


The  SEW  cor  STS  show  the 
maximum  num4<r  of  data 
structure n  needed  f,:r  the  prob¬ 
lem  The  structure  called 


NE*  COUNTS 
NUMBER  FREE 


ARITH 

0 


CPX  GRAPH 
38  37 

28  27 
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*,«ji 
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B.4.  Results  generated  for  k=3 


INDUCE  3  -  VERSION  AS  OF  AUCUST  25  1984 

THIS  RUN  MADE  ON  84,09,  18 
INITIALIZING  (“FIGS) 


VARIABLE  NAME  VTYPE 

VCOST 

TRACE 

sPT 

LIN 

1 

STOPS 

st? 

LIN 

1 

PRINT  RULES  TRUE 

sDIFF 

LIN 

1 

SHAPE 

STR 

1 

SIZE 

LIN 

l 

PARAMETERS  GENERAL 

VL 

AQ 

L-RULE 

REGENSTAR  ! 

VLMAXSTAR 

4 

AQMAXSTAR  4 

MAXL 

METATRIM 

1 

NCONSIST 

4 

AQCUTF 1  20 

DESCTYPE 

DISC 

ALTER 

4 

LOST  FALSE 

EXTMTY 

TRUE 

M INCOVER  100 

EQUIV 

TRUE 

MAXBACK 

0 

VLNF=3 

AQNF  =2 

LRNF=4 

CRITERION  VLCRIT 

VLTOL  AQCRIT 

AQTOL  LRCRIT 

LRTOL 

-1 

0 

00  -t 

0  00  -1 

0  00 

-2 

0 

00  2 

0  00  2 

0  00 

3 

0 

00 

-3 

0  00 

4 

0  00 

GRAPH  holds  a  complet  in 
graph  form  The  structure 
CPX  holds  a  vector  of  attri¬ 
butes  used  in  the  selector 
value  list  generalization 
phase  Although  till 
different  completes  were  gen¬ 
erated,  only  S7  were  ever 
stored  simultaneously 


ENTER  ONE  CHAR  <P)  ARA.METERS ,  (V)L1.  (C)OVER,  (M)ODIFY.  (H)ELP  FOR  OPTIONS 
»  u 

ENTER  NUMBER  OF  SEEDS  FOLLOWED  BY  THEIR  EVENT  NUMBERS 
’3159 

NOW  COVERING  EVENT  1  AGAINST  9  5 

THE  FOLLOWING  RULES  COVER  SET  1 

THIS  RULE  COVERS  EVENTS  8784321  (0  NEW) 

RULE  23  EVENT  SETS  1.  COSTS (-8-2  3)  -7  -1  0 
;*PS(SIZE=2)=0  1) 

NOW  COVERING  EVENT  5  AGAINST  9  1 
THE  FOLLOWING  RULES  COVER  SET  1 
THIS  RULE  COVERS  EVENTS  5  4  <0  NEW) 

RULE  45  EVENT  SETS  l.  COSTSC-8-2  3)  -2  -1  0 
I»PS(TEXTURE=0)  =  1I 


The  response  directs  the  con¬ 
struction  of  three  classes  The 
initial  seeds  are  events  I,  5. 
and  B 


NOW  COVERING  EVENT  9  AGAINST  5  1 
THE  FOLLOWING  RULES  COVER  SET  1 
THIS  RULE  COVERS  EVENTS  9  8  7  (0  NEW) 

RULE  85  EVENT  SETS  1.  COSTSC-8-2  3)  -3  -1  0 
[«PS(TEXTURE=0)=0i 


EVENTS  COVERED 
1  2  3  4  8  7  8 
EVENTS  COVERED 
4  5 

EVENTS  COVERED 
7  8  9 

“ULTIPLY-COVERED  EVENTS 
4  7  8 

UNIQUELY  DETERMINED 


The  completes  mutt  be  adjust¬ 
ed  to  fit  events  7  and  ? 
such  that  they  are  singly 
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1  2  3  5  6  9 


covered  Thtt  procett 

proceed t  at  before  for  k=C 
The  ttept  taken  during  (hat 
proeett  are  not  thown  in  thu 
luting 


v'JIX  COVERING  CLUSTER  t  (EVERTS  6  3  2  1) 

RULE  216  EVERT  SETS  1.  C0STS(-6-2  3)  -4  -41  0 
FOftALL-PS(SHAPE=SQUARE)=FALSE; ;FORALL-PS(SHAPE=RECTANGLE) ^false: 

; forall -ps(sh*v  -DIAMOND) -false: [FORALL- PS (SHAPE: TRIANGLE) -false: 

[FORALL- PS  tS":;  r.:;iRCL£)=FALSE:  :forall-ps(shape^ellipse)^false; 
;F0RALL>PS(S1.“PK=USHAFE)=FALSE; [forall-ps(shape=polygon)=false; 

: FORALL- PS (SHAPE: CURVED ) =FALSE[ [FORALL - PS (S IZE-O) =FALSE; 

[FORALL-PS (SIZ£=  t ) = FALSE;  [FORALLPS(SIZE:2) :FALSE;  [ FORALL- PS (TDCTURE^O ) : FALSE 
;  FORALL -PS  ( TEXTURE:  1 )  = FALSE [  ;  VST-ONTOP  (P 1 ) :  [ONTOP  (PI  .  P2)  [  ;SA*ESIZE(P  1  P2)  : 
[SHAPE (PDsRECTARGLE:  [ SHAPE ( P2 )* SQUARE)  [SIZE(Pt)=i;  •SIZE(P2>-1’  I TD(TURE(P  1 )  =  • 
[TEXTUR£(P2>:*] :3DIFF-SHAPE:3J  ;*DIFF-SIZE:2: [ »D IFF- TEXTUR£=2 I 
:*PS(SHAPE=CURVED)#0] [ «PS (SHAPE^SQUARE) =0  1 ]' #PS (SHAPE: RECTANGLE) =0  1’ 

[ 3PS (SHAPE= DIAMOND) =0  1] [ s PS (SHAPE: TRIANGLE) -0  1] [ #PS (SHAPE: CIRCLE) #3] 

;#PS (SHAPE: ELL IPSE) =0  1 [ [ aPS (SHAPE=USHAPE) =0  1 ] [aPS (SHAPE: POLYGON) = 1  2] 

:#PS(SIZE=1)=2]  >PS(SIZ£:2)=0  i]  { *PS  (SIZE=0)  «3j  [  #PS  (TEXTURES)  =2  3] 

[  »PS (TDCT'JRE:  t )  =  1  2]  [aPS=3  4] 


Here  are  the  clatt  detenptiont 
of  the  three  retulting  cluttert 
They  are  i  Uustrated  in  the 
upper  part  of  Fig  6  6 


RULE  COVERING  CLUSTER  2  (EVERTS  5) 

RULE  437  EVENT  SETS  t.  C0STS(-8-2  3>  -1  -47  0 

; FORALL-PS (SHAPE= SQUARE) =FALSE] ] FORALL- PS ( SHAPE r RECTANGLE) =FALSE] 

:fcrall-pscshape=diamond) -False]  'forall-ps (shape-- triangle)  = false] 

■ FORALL-PS (SHAPE=CIRCLE) -FALSE] ] FORALL-PS (SHAPE- ELLIPSE) -FALSE] 

;forall-ps(shape=ushape)=false; :forall  ps ( sh ape =polycon)= false] 
;forall-ps(shape=curved)=false] ; forall-ps (size;o)=false] 

FORALL  PS (SIZE=1)=FALSE]  :foRALL-PS(SIZE--2)=FALSE]  ;kORALL-PS(TE2(TURE-0):FALSE: 
:F0RALL-PS(TEXTURE=1)=FALSE; :LST-0NT0P(P3)] ("ST-ONTOP(Pl) ] [0NT0P(PI , P2) ] 
:0NT0P(P2.P3)!  :sa,YESIZE(P1  P3)]  ;SA“ETEXTUR(P1  P3) ] [SHAPE(P1 ) ^CIRCLE) 

] SHAPE (P2) -TRIANGLE] 'SHAPE(P3) =USHAPE] ;SIZE(PI)=2! ;SIZE(P2)=1] !SIZE(P3)=2] 
fTEXTURE(P2)=0!  ] TD(TURE(P3) - 1  ]  TEXTURE(P1 )  =  I  ]  '«0IFF-SHAPE=3]  ]«DIFF-SIZE^2! 
;*DIFF-TEXTURE=2] ;«PS (SHAPE= ELLIPSE)  =0]  ;«PS(SHAPE-USHAPE)=t ] 
'.*PS(SHAPE=POLYGON)  =  lj  ]  3PS  (SHAPE- CURVED)  -  1  ]  ] *PS (SHAPE=SQUAR£) =0] 

: =PS (SHAPE-RECTANGLE) =0] ] aPS (SHAPE=0 IAMONO) =0] ] tPS (SHAPE- TRIANGLE) = 1 ] 
:3PS(SHAPE=CIRCLE)=l! :»PS(SIZE=l)=l! [3PS(SIZE=2)=2] !»PS(SIZE=0)=0! 

] sPS (TEXTURE=0) = l ] '«PS(TEXTURE= 1 ) =2] [«PS=3] 


RULE  COVERING  CLUSTER  3  (EVENTS  9874) 

RULE  1798  EVENT  SETS  1.  C0STS(-8-2  3)  -4  -37  0 
:FORALL-PS(SHAPE=SQUARE)=FALSE]  :forall-ps(shape=rectangle)=false: 

] FORALL -PS (SHAPE- DIAMOND) = FALSE! [ FORALL-PS (SHAPE: TRIANGLE) -FALSE] 
FORALL-PS(SHAPE=CIRCLE)=FALSEi  ]  FORALL  -  PS  (SHAPE:FXLIPSE)  : FALSE] 

; forall-ps (shape=ushape)=false!  ;forall-ps(shape--polycon)=false! 

] FORALL-PS (SIZE=0)  =  FALSE!  i FORALL-PS (SIZE=2)  =  FALSE]  ( FORALL-PS  (TEXTURE- 0)  =  false: 
;yST-ONTOP(Pl)I  'ONTOP (PI. P2)!  'SHAPE  (PI )  2 CIRCLE]  ] SHAPE ( P2 )= CURVED I  :SIZE(P1 ) --•] 
:siZE(P2)*0]  [ TEXTURE(P2)  =  1 1 ]TDCTURE(P1 )  =  * ] ]»DIFF-SHAPE=2  3] I KDIFF-SIZE- 1  2] 

■«DIFF~TEXTURE=1  2] ' *PS (SHAPE=ELLIPSE) =0  1 ] !»P5(SHAPE=USKAPE) =0  1] 

;«PS(SHAPE=P0LYG0N)=0  1] ] »PS (SHAPE=CURVED) «0 J f  UPS (SHAPE=SQUARE) -0  1] 

[*PS(SHAPE=RECTANGLE)=0  !’ C «PS(SHAPE=DIAPOND) =0] I # PS (SHAPE- TRIANGLE) =0 
:3PS(SHAPE=CIRCIJE)*3;  t»PS(SIZE=2)«3!  i sPS (SIZE'O)  =0  1]  i*PS(SIZE=  1 ) *3] 

;»PS (TEXTURE::!)  =2  3]  [»PS(Ti0(TURE=0)=0  l];sPS=2  3] 


l ! 


THE  FOLLOWING  EVENTS  COULD  NOT  BE  COVERED  (NONE) 


FINDING  NEWSEEDS 


CN0=1 

EVENTS l 

DSUM: 

4 

2000000000000E*00 1 

CNO=  1 

EVENT=2 

DSUM= 

4 

2000000000000E*  00 1 

CN0=1 

EVENT=3 

DSUM= 

3 

6000000000000E*  00 1 

CN0=  1 

EVENT=6 

DSUM= 

4 

OOOOOOOOOOOOOE-OOt 

CN0  =  2 

ET/ENT:5 

DSU^= 

0 

OOOOOOOOOOOOOE^OOO 

CN0=3 

EVENT=4 

DSUM: 

5 

4000000000000E-00 1 

CN0=3 

EVENT=4 

DSUM= 

5 

4000000000000E-00 1 

CN0=3 

EVENT: 7 

DSUM= 

6 

2000000000000E*00 1 

CN0=3 

EVENT:8 

DSUM= 

6 

oooooooooooooe*oo 1 

CN0  =  3 

EVENT:9 

DSUM= 

7 

8000000000000E*00 1 

The  lumi  of  dietaneet  to  other 
eventi  are  given  in  thie  table 


i 


4 

t 
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ENTER  NUMBER  OF  SEEDS  FOLLOWED  BY  THEIR  EVENT  NUMBERS 
■>  3  3  5  4 

NOW  COVERING  EVENT  3  AGAINST  5  4 

THE  FOLLOWING  RULES  COVER  SET  1 

THIS  RULE  COVERS  EVENTS  6  3  2  1  (0  NEW) 

RULE  1819  EVENT  SETS  1.  COSTSC-6-2  3)  -4  -I  0 
:«PS(TEXTURE=C)=2  3! 

NOW  COVERINC  EVENT  5  AGAINST  4  3 

THE  FOLLOWING  RULES  COVER  SET  1 

THIS  RULE  COVERS  EVENTS  985  (0  NEW) 

RULE  1839  EVENT  SETS  1.  C0STS(-6-2  3)  -3  10 

;5PS(SIZE=l)-0  i; 

NOW  COVERING  EVENT  4  AGAINST  5  3 
THE  FOLLOWING  RULES  COVER  SET  1 
THIS  RULE  COVERS  EVENTS  8  7  4  (0  NEW) 

RULE  1856  E/ENT  SETS  1.  C0STS<-8-2  3)  3  -t  0 

;*DIFF-SHAPE*3! 

EVENTS  COVERED 
12  3  6 

EVENTS  COVERED 
5  8  9 

EVENTS  COVERED 
4  7  8 

MULT IPLY-COVERED  EVENTS 
8 

UN I QUEL  Y  DETERMINED 
12  3  4  5  6  7  9 


RULE  COVERINC  CLUSTER  1  (EVENTS  8  6  3  2  1)  TKe  following  clan  deacnp- 

RULE  2466  EVENT  SETS  l.  COSTSI-6-2  3)  -5  -38  0  tiona  give  tkt  tecond  clutter 

,FORALL-PS(SHAPE=SQUARE)rFALSE:  :FL«AU.-PS(SHAPE=R£CTANGLE)=FALSE:  mg  II  it  illuatrate  d  in  tkt 

;FORALL-PS(SHAPE=OIAMOND)=FALSE:  :FaRALL-PS<SHAPE=TRIANGLE)=FALSE:  lower  part  of  Fig  6  6 

; forall-ps (shape=circle)=false: ;forall-ps(shape-ellipse)=false: 

; forall-ps (shape=ushape) =false; : forall-ps (shape-polygon) =false! 

' FORALL-PS (SHAPE= CURVED) r FALSE] ! FORALL-PS (5IZE=0) =  FALSE’ 

; forall-ps (size=d=false:  ; forall-ps (size-25=false;  :forall-ps(texture-o)=false; 

;“ST-0NT0P(P1) :  :0NT0P(P1  P2)!  :sHAPECP1)»CIRCLE: ! SHAPE (P2) »S8UAR£'  S I ZECP1 ) so; 

:SIZE(P2)m:  :tEXTURE(P2)=*;  ;TEXTURE(P1)-*'  :  jDIFF-SHAPE=2  3;  ;«DIFF  SIZE  2! 

,»DIFF-TD(TURE=l  2;  >PS (SHAPE^USHAPE)  =0  I ;  ;  »PS(SHAPE=POLYCON)  -  l  2! 

:sPS(3HAPE=CURVED)»0]  I  sPS  (SHAPE=S(JUARE)  =0  t «PS  (SHAPE:  RECTANGLE)  =0  l! 

;*PS(SHAPE=0IAMOND)=O  1’  ! »PS(SHAPE=TRIANGL£>  =0  ll  (sPStSHAPE-'CIRCLE)  J3! 

' *PS (SHAPE- ELLIPSE)  =0  1  ’  I»PS (SIZE=2)  =0  1  ;  ; sPS (SIZE=0) »3K »PS (SIZE- 1 )  =  1  2! 

' 4PS ( TEXTURE^ 1 )  =  1  2;  ;3PS»0  1! 

RULE  COVERING  CLUSTER  2  (EVENTS  9  5) 

RULE  2211  EVENT  SETS  t.  C0STS(-«-2  3)  -2  -44  0 
:fORALL-PS(SHAPE=S(JUARE)=FALSE;  ; FORALL-PS  (SHAPE- RECTANGLE)  =FALSE! 

: forall-ps (shape=diamono)=false: : forall-ps(shape= triangle) =false; 

; FORALL-PS  (SHAPED IRCL£)=FALSE:  ! FORALL-PS  (SHAPE1  ELLIPSE)  -  FALSE] 

: FORALL-PS(SHAPE=USHAPE) iFALSE:  ' FORALL -  PS ( SHAPE =  POLYGON ) =FALSEj 

;forall-ps(shape=curved)=false: ;forall-ps(size-o)=false: 

:  FORALL- PS  (SIZE=1)=FALSE:  :fORALL-PS(SIZE  =  2)  =FALSE!  :  FORALL-PS  (TEXTURES )-  FALSE, 

;LST-0NT0P(P3): :mST-0NT0P(P1) : :0NT0P(P1 ,P2) !  0NT0P(P2 . P3) ) :SHAPE(P1 ) 4RECTANGLE, 

;shape(P2)*square;  :shape(P3)=ushape;  :gtze<pi)--«;  :size(P2)»oj  ;size(P3)=2; 


Tkt  only  multiply  covtred 
event  it  event  1  Tkt  com- 
plexet  are  adjuated  to  cover  i( 
uniquely  The  itepi  of  tk if 
proceta  are  not  ahown  in  tkia 
hating 


The  next  iteration  it  requcated 
by  giving  the  three  teed  event 
numbert  eorreapondmg  to  the 
eventa  which  have  the 
minimum  diatancea  in  the 
above  table  They  are  eventa 
S.  5.  and  f 


:texture(P3)  =  i;  ;  texture  (pi  )m:  ;texture(P2)=»  ;»diff-shape=3:  ;sdiff-size-2: 

;»DIFF- TEXTURE- 1  21 I#PS (SHAPE=DIAM0N3) =0 L sPS(SHAPE= TRIANCLE) =0  1) 

>PS (SHAPE-CIRCLE)  =0  1 !  I «PS(SHAPE-ELLIPSE)  =0  l i : «PS (SHAPE  USHAPE) - 1 ! 

' # PS (SHAPE= POLYGON ) = 1 ] ' *PS (SH APE : CURVED) = 1 [  ' *PS (SHAPE -SQUARE) : 0  l! 

;  s  PS  (SHAPE= RECTANGLE)  =0!  .sPS <SIZE= 1 ) =0  l!  '  «PS(SIZE-2)  =2!  «PS(SIZE^O)  ^0  1 

*PS(TEXTURE=0)=0  1 ] ! sPS (TEXTURE^ 1 ) =7  3::*PS=3: 


|  3 

V 


RULE  COVERING  CLUSTER  3  (EVENTS  7  4) 

RULE  2348  EVENT  SETS  1.  C0STS(-8-2  3)  -2  -38  0 

;forall-ps(shape=square) =false; :forall-pg(shape=rectangle) ^false; 


morns'- 


<•,  V..-,  .  .  w  r  r. 


i 

i 


I 


3 

s 


4 


t 
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' forall -ps(shape=diauond)=false;  ; forall -pscshape= triangle) ^false; 

;  ~orall-ps (shape=circle) = false’ :  forall  - ps (shape=ellipse) =false: 

FORALL  -PS  (SHAPE=USHAPE)  ^FALSEl  1  FORALL  -  PS  (SHAPE-POLYGON)  =  FALSE: 

.FORALL- PS  (SIZE=0)=FALSE:  :F0RALL-PS(SIZE-2)=FALSE:  ;  FORALL- PS  (TD<TURE=0)  -  FALSE; 

;lst-ontop(P2)  ;  ;mst-ontop(pd ;  ;ontopcpi  .  P2) :  ;shape(pi )»square: 

; sh ape (P2)=  curved;  ;size(pi)»o;  ;size(P2)=i  :texture(pi)=«;  'texture(P2)  =  i; 
;jdiff-shape=21  ;«diff-size-  i  2;  :#diff- textures  2!  :jps<shape=ushape)=o] 

:  JPS(SHAPE=P0LYG0N)=0  1:  :*PS(SHAPE=CURVED)sO'  1  sPS(SHAPE=SQ'JARE)  =0! 

;sPS(SHAPE= RECTANGLE) -0] :sPS(SHAPE=DIAMOND) =0! ; «PS(SHAPE=TRIANCLE) =0  t! 

; *PS (SH APE- CIRCLE) *3] I sPS (SHAPE=ELLIPSE)  =  1 ]  :«PS(SIZE=0)=0] [ »PS (SIZE= 1 ) =2! 
;sPS(SIZE=2)=0  i;  ;«PS(TEXTURE=0)=0  11 ;sPS(TE<TUR£=l)=2; IsPS=2  3! 


THE  FOLLO.INC  EVENTS  COULD  NOT  BE  COVERED  (NONE) 


FINOING  NEWSEEDS 

CN0=1  EVENT7 1  DSUM=  5  7000000000000E-00 I 

CNO- 1  EVENT  =  2  DSUM:  5  8000000000000E* 00 l 

CN0=1  EVENT=3  DSUM7  S  3000000000000E-001 

CN0=1  EVENT -6  DSUM=  5  8000000000000E-001 

CN0=1  EVENT  =  8  DSUM=  7  OOOOOOOOOOOOOE-OOI 

CN0=2  EVENT=5  DSUM=  1  7000000000000E-00 I 

CNO =2  EVENT  =  9  OSUM=  1  7000000000000E-001 

CN0=3  EVENT  =  4  DSUM=  1  7000000000000E*001 

CN0=3  EVENT=4  DSUM-  1  7000000000000E-001 

CN0=3  EVENT=7  DSUM=  3  4000000000000E-001 

ENTER  NUMBER  OF  SEEDS  FOLLOWED  BY  THEIR  EVENT  NUMBERS 
7  3  7  8  9 

NOW  COVERING  EVENT  7  AGAINST  9  8 
THE  FOLLOWING  RULES  COVER  SET  1 
THIS  RULE  COVERS  EVENTS  784321  (0  NEW) 

RULE  2737  EVENT  SETS  1.  C0STS(-8-2  3)  810 

' »PS(SIZE- l ) =2  3) 

NOW  COVERING  EVENT  8  ACAINST  9  7 
THE  FOLLOWING  RULES  COVER  SET  1 
THIS  RULE  COVERS  EVENTS  8  5  (0  NEW) 

RULE  2753  EVENT  SETS  l.  C0ST3(-8-2  3)  -2-10 

;sps(size=i)=i; 

NOW  COVERING  EVENT  9  AGAINST  8  7 
THE  FOLLOWING  RULES  COVER  SET  1 
THIS  RULE  COVERS  EVENTS  95  (0  NEW) 

RULE  2771  EVENT  SETS  1.  COSTSC-8-2  3)  -2  -1  0 
;=PS(SIZE--2)=2  31 

EVENTS  COVERED 
1  2  3  4  8  7 
EVENTS  COVERED 
5  8 

EVENTS  COVERED 
5  9 

MULTIPLY -COVERED  EVENTS 
5 

UNIQUELY  DETERMINED 
1  2  3  4  6  7  8  9 

RULE  COVERING  CLUSTER  1  (EVENTS  8  7  8  5  4  3  2  1)  The  following  clan  detcnp- 

RULE  3364  EVENT  SETS  1,  C0STS(-6-2  3)  -7  -38  1  tioni  present  the  generated 

;fORALL-PS(SHAPE=SQUARE)=FALSE:  ;F0RALL-PS<SHAPE=RECTANGLE)  =  FALSE:  cluttering 

’forall-ps(shape=diamond)=false; ;forall-ps(shape=triangle)=false: 

FORALL-PS(SHAPE=CIRCLE) =FALSE; 'F0RALL-PS(SHAPE;ELLIPSE)=FALSE; 

' FORALL- PS (SHAPE=USHAPE) -false: 1 FORALL- PS (SHAPE-POLYGON) -FALSE; 

FORALL-PS(SIZE-O) -FALSE;  '  FORALL-PS  (SIZE  2)  ’FALSE:  !  FORALL- PS  ( TFDCTURE’ 0 )  ’FAISE’ 

:“ST  ONTOP(Pl);  .0NT0P(P1  .  P2) "  'SHAPE(P1  )-•  ’SHAPF.(P2)  sSQUARE;  SIZE 'PI  )=0' 

size(P2)=l  ::exture(P2)=»: :texture(pi)-«  :»oiff-shape=2  3;  jdiff  size=i  2; 

70  IFF  -  TEK7URE=  1  2:  >PS  (SHAPE7  ELL  IPSE) -0  I  «PS(SHAPE- USHAPF.)  -0  1 ' 

3PS  ( SHAPE7  POLYGON ) S3;  . 3PS (SHAPE-CURVED ) 30  3PS(SHAPE=SQUARE) ’0  1' 


Event  5  is  multiply  covered 
Comple zee  will  he  adjueted  to 
cover  i!  uniquely 


The  nett  iteration  ■«  begun  by 
entering  the  teed  event 
number!  The  even ti  7  S.  and 
3  are  telected  became  they 
have  the  minimum  dittance 
valuer  in  the  above  table 


Thu  table  gives  the  turns  of 
dntancei  to  the  events 
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=  PS (SHAPED  RECTANGLE) =0  l]  >PS(SHAPE=DIAMOND) =0  1 sPS (SHAPE- TRIANCLE) =0  1] 

2PS (SHAPE-CIRCLE) S3;  sPS (SIZE=2) «3] ! sPS (SIZE-O) *3 ] ] »PS (SIZE= 1 ) = 1  2] 

sPS (TEXTURE11 1 )  =  l  2'.  .=PS=0  1  'j 


RULE  COVERING  CLUSTER  2  (EVENTS  8) 

RULE  3033  EVENT  SETS  I.  COSTS (-6-2  3)  -1  -42  0 
;forall-ps(shape=square)=false: [FORALL-PS (SHAPE=RECTANGLE)sFALSE] 
;F0RALL-PS(SHAPE=DIA.«0ND)=FALSE;  ' FORALL-PS (SHAPE= TRIANGLE) = FALSE] 

; FORALL-PS (SHAPE=CIRCLE) = FALSE] ;FORALL-PS (SHAPE=ELLIPSE) = FALSE] 

; FORALL- PS (SHAPE=USHAPE)= FALSE] [FORALL-PS (SHAPE= POLYGON ) =FALSE] 

.'FORALL-PS  (SHAPE=CURVED)=  FALSE]  [FORALL-PS  (SIZE=0)  =FALSE] 

;forall-ps(size=d=false;  ;forall-ps(size=2)=false:  [forall-ps (texture=o)=false; 

; F0RALL- PS ( TEXTURES  1)]  [LST-ONTOP (P2) ]  [MST-ONTOP(Pl) ]  [ONTOP (P 1 . P2) ' 
[SAVETEXTURCPt  P2)] ! SHAPE (P 1 ) = RECTANGLE] [SHAPE(P2) =CIRCLE] ;SIZE(P1)=2] 
:SI2E(P2)=i; .TEXTURE (P2)=l] , TEXTURE(P1 ) = 1 . ! «DIFF-SHAPE=2; ]»D IFF-S IZE=2 . 

=  0  IFF- TEXTURE: 1]  [ sPS (SHAPE= SQUARE) =0]  [  sPS (SHAPED RECTANGLE)  =  I ] 

; sPS (SHAPE: DIAMOND) =0] [ sPS (SHAPE-TRIANGLE) =0] { sPS (SHAPE^CIRCLE) = 1 ] 
sPS (SHAPE- ELLIPSE) =0]  [ sPS(SHAPEsUSHAPE) =0 ]  [ sPS (SHAPErPOLYGON)  =  1 ] 

; sP3 (SHAPEsCURVED) s 1 ] [sPS (SIZE=2)=l] [ sPS (SIZE^O) =0] [#PS (SIZE= 1 ) = l ] 

[ *PS( TEXTURE^ l ) =2] [#PS(TEXTURE=0> =0] [#PSs2] 


RULE  COVERING  CLUSTER  3  (EVENTS  9) 

RULE  3244  EVENT  SETS  1.  COSTSC-8-2  3)  -l  -47  0 

[FORALL-PS CSHAPE=SQUAR£)=FALSE] [FORALL-PS (SHAPE= RECTANGLE) = FALSE] 

;FORALL-PS(SHAPE=DrAMOND)=FALSE]  'FORALL-PS (SHAPED  TRIANGLE) =FALSE] 

;forall-ps(shapescircle)sfalse]  ;forall-ps(siiape=eu_ipse>=false] 

; FORALL-PS (SHAPE=USHAPE)rFALSE] : FORALL-PS (SHAPES POLYGON )s FALSE] 

[ FORALL-PS (SHAPEsCURVED )=FALSE] [ FORALL-PS (SIZEsO)sFALSE] 

[FORALL-PS  (SIZE=n=FALSE] [F0RALL-PS(SIZEs2)sFALSE! [  FORALL- PS  (  TEXTURES)  =FALSE] 
; FORALL-PS (TEXTURES l ) ]  ]LST-ONTOP (P3) ]  [MST-0NT0P(P1 ) ]  ;ONTOP(Pl .P2) ] 

ONTOP (P2. P3) ] [SAMESIZE(P2  P3) ] [SAMETEXTUR (P I  P2  P3) ] [SHAPECP 1 ) ^SQUARE] 

; SH APE (P2) SELL IPSE] ;SHAPE(P3)=USHAPE] :SIZE(Pt)-0; :siZE(P2)=2: :SIZE(P3) -2] 
TEXTURE(P2)=l]  [ TEXTURECP3)  =  1 ;  [ TEXTURE (P 1 )  =  l ]  ! »D  IFF-SHAPE7  3 ]  [ aDIFF-SIZE=2] 

;*D IFF- TEXTUR£= 1] [ *PS (SHAPEs ELL IPSE) = 1 ]  « PS (SHAPE =USH APE) = 1 ] 
;=PS(SHAPE=P0LYG0N)=1] [ sPS (SHAPE: CURVED) r 1 ] [ sPS (SHAPE^SQUARE) : \ ) 

; *PS (SHAPEr RECTANGLE) =0]  [*PS(SHAPE=DIAMOND) =0]  [ *PS (SHAPE:  TRIANGLE) r0 ] 

; »PS (SHAPED CIRCLE) ^0] [ *PS (SIZE= l ) =0 ] [sPS (SIZE=2) =2] [ «PS (SIZEsQ) = 1 ] 
>PS(TEXTUREs0)=0]  [ »  PS  ( TD( TUR£=  0=3]  >PSs3] 


THE  FOLLOWING  EVENTS  COULD  NOT  BE  COVERED  (NONE) 


FINDING  NE- SEEDS 


CN0=1 

EVENTS  1 

DSUMs 

1 

0300000000000E*  002 

The  following  table  of 

fomf  of 

CNO  =  1 

EVENTs2 

DSUMs 

1 

1 OOOOOOOOOOOOE ‘ 002 

dutancee  e  on  tat  nit 

value  t 

CN0=1 

EVENT=3 

DSUMs 

9 

8000000000000E-00 1 

greater  than  the  la»t 

c/u#(<r- 

CNO  =  1 

EVOT  =  4 

DSUM= 

l 

0400000000000E-002 

mg  Since  there  if 

no  itn- 

CNO  =  1 

EVENTs4 

DSUM= 

1 

0400000000000E*002 

provement,  the  program  if  ter- 

CNQs  1 

EVENT=5 

DSUMs 

1 

2000000000000E*  002 

mtnated 

CNO=  1 

EVENT=6 

DSUMs 

1 

0200000000000E*  002 

CNO=  1 

EVENT=7 

DSUMs 

1 

11 OOOOOOOOOOOE * 002 

CN0  =  2 

EVENTS 8 

DSUMs 

0 

OOOOOOOOOOOOOE*  000 

CN0  =  3 

EVZNT=9 

DSUM= 

0 

0000000000000E*000 

ENTER  ONE  CHAR  (P) ARAMETERS .  (V)L1.  (C)OVER.  (M)ODIFY.  (H)ELP  FOR  OPTIONS 

?  q 

CPU  TIME  USED  173  189  SEC 


TABLE  OF  PROCEDURE  USE  COUNTS 


614-ALLC 
0- ADDCONS 
3 1 4  - ADDLINK 
33-CCOVER 
0 -CALCAR  I TH 
3776-FREECRPH 
O-LSCHOOSE 
7073-NEWC 
3872-COPYCPX 
29085 -SUBG 
33-TRIwM 


73-AQ 

305- ABSOURB 
5626-COSTC 
8748-COSTG 
1056-C0MP WS 
6829-FREECPX 
33  - ADD^ETA 
3786 -NE.G 
3872- COP YGRPH 
347 -TRIMC 
848  -  TOOSMALL 


97-AQSET 
0  AP PL RULES 
0 -CLEANCPX 
33 -COVER 
2580  EXTND 

0  SUBGDETAIL 
97- ADDTOMQ 
848  NE-GP 
0  PROCAR  I  TH 
272-TRIvG 
0-VL1 


9-ADDSEL 
0- ADDLRULES 
3 -CLUSTER 
O-COSTL 
14214 -FREETAB 
74  LQST2 
688  NC.CPXTAB 
3- NE- SEEDS 
62096- JUBG1 
O-TRIML 
1 1  - VL I  NT 


>  bt  iwiwi 


58532-CPXCOV 


233-GEN RLIZ 


ARITH 

SCWA 

LRULE 

CPXTB 

CPX 

GRAPH 

NE-  COUNTS 

0 

1 

0 

10 

70 

35 

number  free 

- 

- 

10 

60 

25 

B.5.  Results  generated  for  k=4 


INDUCE  3  VERS  ION  AS  OF  AUGUST  25  1984 


THIS  RUN  MADE  ON  84  09  22 
INITIALIZING  (MFIGS) 


VARIABLE  NAME  VTYPE 

VCOS’i 

TRACE 

«?T 

LIN 

l 

STOPS 

#P 

LIN 

l 

PRINT  RULES  TRUE 

#DIFF 

LIN 

l 

SHAPE 

STR 

l 

SIZE 

LIN 

1 

PARAMETERS  GENERAL 

VL 

AQ 

LRULE 

REGENSTAR  1 

VLMAXSTAR  2 

AQMAXSTAR  4 

MAXL 

METATRIM 

1 

NCONS 1ST  2 

AQCUTF1  20 

OESCTYPE 

DISC 

ALTER  2 

LQOT  FALSE 

EXTMTY 

TRUE 

M incover  too 

EQUIV 

.  TRUE 

MAXBACK  0 

VLNF=3 

AQNF -2 

LRNF-4 

CRITERION  VLCRIT 

VLTOU  AQCRIT 

AQTOL  LRCRIT 

LRTOL 

~  1 

0 

00  -l 

0  00  -1 

0  00 

2 

0 

00  2 

0  00  2 

0  00 

3 

0 

00 

3 

0  00 

4 

0  00 

W 


\ote  that  parameter  s 
V  L  AM  .VS  TA  R  SCO  SSIS  T 
and  AL  TER  have  been  set  to  C 
to  conserve  epu  time 


ENTER  ONE  CHAR  (P) ARA VETERS  (V)L1 .  (C)OVER.  (V)ODIFY.  (H)ELP  FOR  OPTIONS 
7  u 


ENTER  NUVBER  OF  SEEDS  FOLLOWED  BY  THEIR  EVENT  NUVBERS 
7  4  1  2  3  4 

NOW  COVERING  EVENT  I  AGAINST  432 
THE  FOLLOWING  RULES  COVER  SET  1 
THIS  RULE  COVERS  EVENTS  851  (0  NEW) 

RULE  22  EVENT  SETS  1.  C03TSC-6-2  3)  -3  2  0 

;size(pi)=2] ;*ps(shape=c:rcle)=i  3] 

NOW  COVERING  EVENT  2  AGAINST  4  3  1 
THE  FOLLOWING  RULES  COVER  SET  1 
THIS  RULE  COVERS  EVENTS  762  (0  NEW) 

RULE  47  EVENT  SETS  1,  C0STS(-6-2  3)  -3  -1  0 

:*pscsize=2)=o; 

NOV  COVERING  EVENT  3  AGAINST  4  2  1 
THE  FOLLOWING  RULES  COVE R  SET  1 
THIS  RULE  COVERS  EVENTS  973  (0  NEW) 

RULE  50  EVENT  SETS  1.  COSTS ( -6-2  3)  -3  -20 
; sPS (SHAPE= ELLIPSE) «0 ;  ; sPS ( SHAPE ^ CURVED) =3 1 

NOW  COVERING  EVENT  4  AGAINST  3  2  1 
THE  FOLLOWING  RULES  COVER  SET  i 
THIS  RULE  COVERS  EVENTS  874  (0  NEW) 


This  response  directs  the  pro¬ 
gram  to  construct  four  classes 
using  the  events  numbered  !. 
C  5.  and  4  os  the  initial  seeds 

These  complexes  results  from 
the  four  stars  built  which  cov¬ 
er  each  seed  event  against  the 
other  seed  events 


•Vi*  Vj.Nj.VV'.  vV'.- >V  'j-  s  ’ 
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RULE  86  EVENT  SETS  1.  C0S'.'S(-6-2  3)  -310 
:=d:ff-shape33, 

r.TXTS  COVERED 

1  5  8 

EVENTS  COVERED 

2  6  7 

EVENTS  COVERED 

3  7  9 

EVENTS  COVERED 

4  7  8 

MULTIPLY-COVERED  EVENTS  The  completes  must  he  adjust- 

7  8  ed  by  XID  to  uniquely  Jit 

UNIQUELY  DETERMINED  events  7  and  ?  to  completes 

1  2  3  4  5  6  9 

RULE  CUVIRING  CLUSTER  1  (EVENTS  8  7  5  0  The  following  eompleiee  are 

RULE  54e  EVENT  SETS  1.  C0STS(-8-2  3)  -4  -38  0  the  result  of  applying  SID 

:forall-i-s;s,iape=square) -false:  [forall-ps (shape: rectangle) =false: 

; forall-ps (shape=diamond):false;  [ forall -ps(shape= triangle) =falsei 
:  forall-ps  (shaped  ircle):  false; [forall-ps (shape=ellipse)=false; 

:forall-ps(shape=ushape)=false: [forall-ps (shape=polygon)=false: 

; forall-ps, shape=curved)=false: [forall-ps (size=o):falsei 

[F0RALL-PSiSIZE=2)  =  FALSE,'  [FORALL-PS  (TEXTURES)  =FALSE!  '"ST-0KT0P(P1>: 

:ONTOP(Pl  .P2>;  [SHAPE(Pl)sELLIPSE!  [SHAPE(P2)  sSQUAREl  [SIZE(PI>«01  !SIZE(P2)o: 

[TEXTURE(P2):«!  [TEXTURE(P1):»!  : 3DIFF-SHAPE=2  3)  '  SDIFF-SIZEM  2] 

>DIFF-TEXTURE=1  21  [ 3PS (SHAPE=ELLIPSE)  =0  1 [ ;«PS(SHAPE-USHAPE) =0  ti 

; =PS (SHAPE -POLYGON) = 1 ] ' 3PS (SHAPE=CURVED) = t ) : spS (SHAPE=SQUAR£) =0) 

:=PS(SHAPE=RECTANGLE)=0  I) [ 3PS (SHAPE-D IAMOND) =0  1 )[ «PS (SHAPE=TRI ANGLE) =0  0 

>PS(SHAPE=CIRCLE)=0  II ! ePS (SIZE=2) 331 [spS(SIZE:0):0I [3PS(SIZE: O = 1  2| 

[3ps(  TEXTURE:  0  =  1  21 [3PS(TEXTUR£=0)33J  [bPS=2  3] 

RULE  COVERING  CLUSTER  2  (EVENTS  6  2) 

RULE  208  EVENT  SETS  1.  C0STS<-8-2  3)  -2  -41  0 

; forall-ps (shape=square):False; [forall-ps (shape=Rectancle):false; 

;fGRALL-PS(SHAPE=DIAMOND)=FALSE;  [ FORALL-PS (SHAPE: TRIANGLE)  -FALSE) 

: forall-ps  (shaped ircle)=falsei  Cforaul-ps(shape=ellipse):Falsej 

[ FORALL-PS (SHAPE=USHAPE):FALSE[ [FORALL-PS(SHAPE=POLYGON):FALSE] 

: FORALL-PS (SHAPE: CURVED) =  FALSE1 [FORALL-PS (S IZE=0) :FALSE! 

F0RALL-PS(SIZE=1)=FALSE:  [FORALL-PS (SIZE:2)=FALSE’  'F0RALL-PS(TEXTURE:O):FALSE: 
F0RALL-PS(TEXTURE=O=FALSE:  [ MST-ONTGP (P 1 )  i  !0NT0P(P1  ,P2)]  [SA"E5IZE(P1  P2>: 

:shape(pi)*rectangle;  [SHAPE(P2)=RECTANGL£'  :size(pi>=i:  ;size(P2)  =  i: 

[TEXTURE(Pl)=«!  [TEXTURE(P2)=01  :»0IFF-SHAPE:3i  :»DIFF-SIZE:2’  [3DIFF-TEXTURE:21 
[3PS(SHAPE=CURVED):2  31 [3PS(SHAPE:SQUARE) =0  1 ! [3PS(SHAPE:RECTANGLE) = 1 1 

[3PS(SHAPE:DIAMOND):OJ [ 3  PS (SHAPE: TRIANGIE) =0) [ SPS (SHAPE=CIRCLE) =21 
[3PS(SHAPE=ELLIPSE)=0  1’ [3PS(SHAPE=USHAPE) :0! [ »PS(SHAPE=POLYCON) : l  21 
;=PS(SIZE=1):2;  ’i!PS(SIZE:2):0i  ;*PS(SIZE:0):2;  [SPS(TEXTURE=0)=2  31 
OPS  (TEXTURE:  1 )  =  1  2i:*PS  =  4] 

RULE  COVERING  CLUSTER  3  (EVENTS  9  3) 

RULE  269  EVENT  SETS  1.  C0STS(-6-2  3)  -2  -44  0 

; forall-ps (shape=square)=false: ;forall-ps(shape=rectancle)=false; 

:FORALL-PS (SHAPE: DIAMOND) =FALSE1 [FORALL-PS (SHAPE: TRIANGLE) :FALSE1 
’FORALL-PS  (SHAPE:  CIRCLE)  =FALSE1  [ FORALL-PS  (SHAPE:  ELLIPSE)  =FALSE[ 

FORALL-PS (SHAPE:USHAPE):FALSE; : forall-ps (SHAPE=P0LYG0N)=FALSE: 

■ forall-ps (shape=curved):false: :forall-ps(size=o):false; 

:  FORALL-PS  (SIZEM)=FALSE:  ;  FORALL-PS  (SIZE--2):FALSE:  [FORALL-PS  (TE2TURE=0)  :FALSE! 

[LST-0NT0P(P3); [MST-ONTOP (P 1 ) [ [0NT0P(P1 . P2) : ;0NT0P(P2.P3) i iSHAPE(Pl):PCLYGON: 

[SHAPE(P2)sSQUARe:  [SHAPE(P3)*P0LYG0Nj  [SIZE(PO«2l  [SIZE(P2)»o:  [SIZECP3)=2: 

’TEXTURE(P3):»;  [  TEXTUR£(PO  :•  [  [  TEXTURE(P2)  :  1 1  [  cOIFF-SHAPE:3l  [sDIFF-SIZE=2; 

[ s D IFF -TEXTURE: t  2[ [3PS(SHAPE:DIAM0ND) :01 'sPS (SHAPE: TRIANGLE) =0  ll 

[3ps(shape:circle):o; ’sps(shape=ellipse):i  : ;sps(shape=ushape):o  i: 

[ 3 PS (SHAPE: POLYGON ) : 1  21 [ 3PS (SHAPE: CURVED) = 1 [ [ sPS (SHAPE: SQUARE) :0  1[ 

:PS (SHAPE : RECTANGLE) =0  1 . 1 sPS (SIZE=  O S3,  [ »PS (SIZE=2) : 1  2[  [ 3PS (SIZE  =  0) =0  il 

3PS(TEXTURE=0)33[ [sPS( TEXTURE: 1)301 [3PS:3l 

RULE  COVERING  CLUSTER  4  (EVENTS  4) 

RULE  346  EVENT  SETS  1.  C0STS(-6-2  3)  -l  -49  0 
FORALL- PS (SHAPE  =  CQUAR£) -  FALSE!  [ FORALL -  PS (SHAPE  RECTANGLE) : FALSE: 


I 


.  FORALL-PS  (SHAPErD  I  A.MOND) =FALSE]  [FORALL-PS (SHAPE- TRIANGLE) -FALSE] 

.FORALL-PS (SHAPE- CIRCLE) -FALSE]  ;FCRALL-PS (SHAPE= ELL  IPSE) = FALSE] 
FORALL-PS(SHAPE^USHAPE)=FALSE: [FORALL-PS (SHAPED POLYGON) = FALSE] 

FORALL-PS (SHAPE=CURVED)]  [FORALL-PS (SIZE-O) = FALSE] [FORALL-PS (SI ZE= 1 ) =FALSE] 
FORALL-PS (S I ZE-2)=FALSL]  FORALL-PS ( TEX  TURE=0 )= FALSE] 

FORALL-PS (TED(njRE-l)=FALSE; [LST  ONTOP(PC) ! ;LST-0NT0P(P3) ] [MST-ONTOP (P 1 ) ] 

QNTOP  (P l , P3) ]  ONTOP (P 1  ,  P2) !  [SA.M£SHAPE(P2  P3) ] [SAMESIZE(P2  P3)  ] 

SA.METEXTUR(P2  P3)j  [ SHAPE (P 1 ) = ELL IPSE] :SHAPE(P2) =CIRCLE] [SHAPE(P3) =CIRCLE] 
SIZE(Pl) -2 ’ :SIZE(P2)=1. ;SIZE(P3)=1] ' TEXTURE(P 1 ) =0] ' TEXTURE(P2) = 1 ) 
TDCTUR£(P3)=i; ] sD IFF-SHAPE=2 ] ] 9DIFF-SIZE=2] [ SDIFF-TEXTUR£=2] 

» PS (SHAPE-POLYGON) =0]  [ s PS (SHAPE=C  ’RVED) -3;  [»PS (SHAPE=SQUAR£) =0] 
3PS(SHAPE-R£CTANGLE;=0: [ sPS(SHAP£=DIAMOND) =0] [ *PS (SHAPE= TRIANGLE) =0] 
s PS (SHAPE=CIRCLE) -2)  [ 3PS (SHAP=;= ELLIPSE) = 1 j  [sPS (SHAPE=USHAPE) =0] [ #PS (SIZE=0) =0] 
sPS(SIZE=l)=2]  :#PS(SIZE=2)  =  l!  ]  s PS  (TEXTURE=0)  =  1 1  [  3PS  ( TEXT’JR£=  1 )  =2 ]  [»PS=3] 


THE  FOLLOWING  EVENTS  COULD  NOT  BE  COVERED  (NONE) 


FINDIiJG  NE-SEEDS 


=1  EVENT: 
=  t  EVENT 
=1  EVENT 
=1  EVENT 
=2  EVENT 
-2  EVENT 
=3  EVENT 
-3  EVENT 
=4  EVENT 
- 4  EVENT 


1  DSUM= 
5  DSUM= 

7  DSUM= 

8  DSUM= 

2  DSUM- 


4  7000000000000E*00 1 
4  5000000000000E*00 1 
4  8000000000000E*  00 1 
4  4000000000000E*00 l 
1  1000000000000E-001 

1  1000000000000E+00 1 

2  lOOOOOOOOOOOOE'OOl 
2  lOOOOOOOOOOOOE-OOt 
0  0000000000000E*000 
0  OOOOOOOOOOOOOE'OOO 


The  sum s  of  distances  to  other 
even ts  are  given  in  this  table 


ENTER  NUMBER  OF  SEEDS  FOLLOWED  BY  THEIR  EVENT  NUMBERS 
’45694 

NOW  COVERING  EVENT  5  AGAINST  964 
THE  FOLLOWING  RULES  COVER  SET  1 
THIS  RULE  COVERS  EVENTS  85  (0  NEW) 

RULE  689  EVENT  SETS  t.  C0STS(-6-2  3)  -2  - 1  0 
]3PS(SIZE=1)=1] 


For  the  second  iteration,  the 
teed  with  the  lowest  distance 
sum  is  selected  from  each 
cluster  developed  in  the  previ¬ 
ous  iteration  The  selected 
seeds  are  events  5,  6,  0,  and  4 


NOW  COVERING  EVENT  6  AGAINST  954 

THE  FOLLOWING  RULES  COVER  SET  1 

THIS  RULE  COVERS  EVENTS  6321  (0  NEW) 

RULE  708  EVENT  SETS  1,  COSTS (-6-2  3)  -4  -1  0 
L 3PS (TDCTUR£=0) =2  3] 


NOW  COVERING  EVENT  9  AGAINST  654 
THE  FOLLOWING  RULES  COVER  SET  1 
THIS  RULE  COVERS  EVENTS  987  (0  NEW) 

RULE  731  EVENT  SETS  1,  COSTS (-6-2  3)  -3-10 
;#PS(TEXTURE=0)=0] 


NOW  COVERING  EVENT  4  AGAINST  965 
THE  FOLLOWING  RULES  COVER  SET  1 
THIS  RULE  COVERS  EVENTS  874  (0  NEW) 

RULE  753  EVENT  SETS  1,  COSTS (-6-2  3)  -3 
;5DIFF-SHAPE*3] 


EVENTS  COVERED 
5  8 

EVENTS  COVERED 
12  3  6 

EVENTS  COVERED 
7  8  9 

EVENTS  COVERED 
4  7  8 

MULTIPLY -COVERED  EVENTS 
7  8 

UNIQUELY  DETERMINED 
1  2  3  4  5  6  9 


vvv 
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RULE  COVERING  CLUSTER  1  (EVENTS  8  7  S) 

RULE  1218  EVENT  SETS  1.  C0STS(-8-2  3)  -3  -38  0 

[forall-ps (shape=square)=false: [forall-ps (shape=rectangle)=false: 

[forall-ps  (shape=dia.yond)=false] ; forall-ps (shape=tri ancle) =false] 

[FORALL-PS(SHAPE:CIRCLE)=FALSE] [ FORALL-PS (SHAPE=ELLIPSE)=FALSE! 

]F0RALL-PS  (SHAPE=USHAPE)  =FALSE]  [FORALL-PS (SHAPE=POLYGON) =FALSE] 

[forall-ps (shape=curved)=false: [forall-ps (size=o)=false) 
'forall-ps(size=2)=false; [forall-ps (texture=o)=false; [mst-ontgp(pi)] 

:0NT0P(P1.P2)I [ SHAPE (Pt)aELLIPSE) ' SHAPE (P2 ) 3SQUARE) ISIZE(P1)30] [SIZE(P2)=1] 
[TEXTUR£(P2)=»] [texture(pi)=i] [aDIFF-SHAPE=2  3! [aDIFF-SIZE=l  2] 
[aDIFF-TD(TURE=l  2] [BPS (SHAPE=ELLIPSE) =0  1 ) [aPS (SHAPE=USHAPE) =0  I] 

[aPS(SHAPE=POLYGON)=lI [aps (SHAPE=CURVED) = 1 ! [:PS(SHAPE=SQUARE) =0] 
[bPS(SHAPE=RECTANGLE)=0  I]  [aPS(SHAPE=DIA.“OND)=0]  ( aPS (SHAPE: TRIANGLE)  =0  li 
[:PS(SHAPE=CIRCL£)=0  1] [aPS(SIZE=2)a3] [ =PS(SIZE=0) =0] [aPS (SIZE= 1 ) = 1  2] 

[  =PS (TEXTURE: t ) =2] [ aPS (TEXTUR£=0) =0  l]  =PS=2  3! 


The  following  eompleiei  ore 
the  remit  of  applying  XID  to 
fit  the  multiply  covered  events 
1 1  and  8}  to  the  complexes 
These  clast  de scriptions  are 
illustrated  in  Fig  6  7 


RULE  COVERING  CLUSTER  2  (EVENTS  6321) 

RULE  874  EVENT  SETS  1.  C0STS(-8-2  3)  -4  -41  0 

; forall-ps (shape=square)=false; ( forall-ps (shape=rectancle)=false] 

[FORALL-PS (SHAPE=DIAYCND) =  FALSE] ( FORALL-PS (SHAP£= TRIANGLE) =FALSE] 

[  FORALL-PS  (SHAPE=CIRCL£)  =  FALSEI  [  FORALL  -  PS  (SH  APE  =  ELLIPSE):  FALSE) 
[FORALL-PS(SHAPE=USHAPE)=FALS£!  ;FORALL-PS(SIIAPE=POLYGON)  =  FALSE] 

[FORALL-PS  (SHAPE=CURVED)=FALSE1  [FORALL-PS  (S I Z£=0)  =  FALSE] 

[FORALL-PS (SIZE=1)=FALSE!  [FORALL-PS  (S IZE=2)  =FALSEJ  [FORALL-PS(TEXTURE=0)=FALSE! 
[FORALL-PS  (TEDCTUR£=  1 )  = FALSE]  [PST-ONTOP  (P  I  )  ]  [ONTOP (P t . P2) )  [SAPESIZE(P1  P2)l 
;SHAPE(P1 ) aRECTANGLE] [SHAPE(P2) aSQUARE] [SIZE(Pl)=l! [SIZE(P2)=l! [ TEXTUR£(P1 ) =  •] 
[TEXTURE(P2)=»! [aDIFF-SHAPE=3] [aOIFF-SIZE=2] ( aD IFF- TEXTURE=2] 
:aPS(SHAPE=CTJRVED)ao! [aPS(SHAPE=SQUARE) =0  1) [apS(SHAPE=RECTANCLE)=0  1) 

[aPS(SHAPE=DIAP0ND)=0  l; ) aPS (SHAPE: TRIANCLE) =0  1 ) ! aPS (SHAPE=C IRCLE) *3) 

aPS(SHAPE=ELLIPSE)=0  I ] [ aPS (SHAPE=USHAPE) =0  1 1  I aPS (SHAPEPOLYGON)  =  1  2] 

;=PS(SIZE=1)=2)  [aps(SIZ£=2)=0  i]  [  aPS(SIZE  0)a3)  [aPSdEXTURE-O)  =2  31 

[:PS(  TEXTURE:  0  =  1  2][aPS=3  4] 

RULE  COVERING  CLUSTER  3  (EVENTS  9) 

RULE  942  EVENT  SETS  t.  C0STS(-6-2  3)  -l  -47  0 

[  FORALL-PS  (SHAPE=SQUARE)=FALSE]  [FORALL-PS (SHAPE: RECTANCLE)  =FALSE] 

! FORALL-PS (SHAPE= DIAMOND) = FALSE] [FORALL-PS (SHAPE= TRIANGLE) =FALSE] 

] FORALL-PS (SHAPE=CIRCLE)=FALSE;  [FORALL-PS (SHAPE= ELLIPSE)  =FALSE] 

[FORALL-PS  (SHAPE=USHAPE)  =FALSE]  [FORALL-PS  (SHAPE:POLYCON)  =FALSE) 

[ FORALL-PS (SHAPE=CURVED)=FALSEi [FORALL-PS (SIZE=0>=FALSE) 

[  FORALL-PS  (SIZE:  l  )=FALSE1  [FORALL-PS  (SIZE  =  2)  =  FALSE]  [FORALL-PS  (TEXTLHULOOFALSE) 
[F0RALL-PS(TEXTURE=O ] [LST-0NT0P(P3) ] [PST-ONTOP(Pl) ] [0NT0P(P1 . P2) ) 
[0NT0P(P2.P3) J  [SAMESIZE(P2  P3)j [SAPETEXTUR(P1  P2  P3) J [ SHAPE (P 1 ) = SQUARE] 
;SHAPE(P2)=ELLIPSE] ;SHAPE(P3)=USHAPE! [SIZE(P1):0] (SIZE(P2)=2) [SIZE(P3)=2! 

[ TEXTURE(P2) = 1 ) [TEXTURE(P3)=lJ [TEXTURECP l ) = 1 ] ( 8DIFF-SHAPE=3; ! 8DIFF-SIZE=2) 
[aDIFF- TEXTURE: l]  [aps(SHAPE:ELLIPSE)  =  1  ]  [ aPS (SHAPE=USHAPE)  =  1 ! 
[aPS(SHAPE=POLYGON)=t: [ BPS (SHAPE=CURVED) = 1 ] [ aPS (SHAPE: SQUARE) = 1 ) 

[a PS (SHAPE: RECTANGLE) =0! [ aps (SHAPE=D IAPONO) =0] [ aPS (SHAPE: TRIANGLE) =0] 

[ *P0 (SHAPE: CIRCLE) =0) [ aPS (SIZE= 1 ) =0] [aPS (SIZE=2) =2) i BPS (SIZE=0) = 1 ] 
l8PS(TEXTURE=0)=0I [aps(TD(TURE=l) =3) [aPS=3l 


RULE  COVERING  CLUSTER  4:  (EVENTS  4) 

RULE  1016  EVENT  SETS  1.  C0STS(-6-2  3)  -1  -49  0 

[FORALL-PS <SHAPE=SQUARE)=FALSE!  [FORALL-PS (SHAPE  =  RECTANCLE)=FALSE) 

[FORALL-PS (SHAPE: 01 AMONG) =FALSE] [FORALL-PS (SHAPE: TRIANGLE) r FALSE] 

[FORALL-PS (SHAPE=C IRCLE) =FALSE] (FORALL-PS (SHAPE=ELL IPSE) =FALSE) 

[FORALL-PS (SHAPE=USHAPE) =FALSE] [FORALL-PS (5HAPE=P0LYG0N) =FALSE] 

[FORALL-PS (SHAPE: CURVED)  ]  [FCRALL-PS(SIZE  =  0)=FALSE)  [FORALL-PS (SIZE:  j )  : FALSE] 
[FORALL-PS  (SIZE=2)=FALSE!  'FORALL-PS  (TEXTURE=0)  =FALSE] 

[FORALL-PS (TDCTURE: 1 ) = FALSE]  !LST-0NT0P(P2) ]  [LST-0KT0P(P3) ) [“ST-ONTOP (PI ) ] 
[0NT0P(P1 ,P3) ] [0NT0PCP1 ,P2) ] [SA“ESHAPE(P2  P3)] [SAYESIZE(P2  P3)j 
[SAKETD(TUR(P2  P3)  [ [SHAPE(P 1 ) =ELLIPSE] [SHAPE(P2):CIRCLE] [SHAPE(P3) =CIRCLE] 
[SIZE(P1)=2] [SIZE(P2):1] [SIZE(P3)=1 J [TEXTURE(P1 ) =0) [ TEXTURE(P2) = 1 ] 

[TEXTURE(P3)  =  i;  [ =0  '.FF-SHAPE=21  [aDIFF-SIZE:2[  [ aDIFF- TEXTURE=2j 
[ aPS (SHAPE: POLYGON) =0] [aPS(SHAPE=OJRVED) =3] (3PS(SHAPE:SQUARE)=0) 

[ =PS (SHAPE=R£CTANGL£) =0] [ aPS(SHAPE=DIAPOND) =0] [ BPS (SHAPE: TRIANGLE) =0] 

[ aps (S.  APE=CIRCLE)=2]  [aPS(SHAPE  =  ELLIPSE)  =  1 ! [8PS(SHAPE=USHAPE) =0) [aPS(SIZE:0):0] 
[ aPS (SIZE: 1 ) :2] [aPS (3IZE=2) = I j  [aPS (TEXTURE=0) = 1 ) [tPS(TEXTURE= 1 ) =2] [aPS:3] 


THE  FOLLOWING  EVENTS  COULD  NOT  BE  COVERED  (NONE) 


DOING  NE-/SEEDS 


CN0=1 

EVENT=5 

DSUM= 

CN0=1 

EVENT-7 

DSUM= 

CN0=1 

EVENT=8 

DSUM= 

CN0=2 

EVENT= 1 

DSUM= 

CN0=2 

EVENT =2 

DSUM= 

CN0=2 

EVENT=3 

DSUM= 

CN0=2 

CO 

ii 

DSUM= 

CN0=3 

EVENT=9 

DSUM= 

CNO-4 

EVENT =4 

DSUM= 

CN0=4 

EVENT =4 

DSUM= 

3  3000000000000E-00 1 
3 . OOOOOOOOOOOOOE-OO 1 

2  7000000000000E*00 1 

4  2000000000000E-001 
4  20Q0000000000£*00 1 

3  6000000000000E+001 

4  OOOOOOOOOOOOOE-OOl 
0  OOOOOOOOOOOOOE-OOO 
0  OOOOOOOOOOOOOE'OOO 
0  OOOOOOOOOOOOOE'OOO 


ENTER  ONE  CHAR  (P) ARAMETERS .  <V)L1.  (C)OVER.  (M)ODIFY .  (H)  F2J*  FOR  OPTIONS 

?  q 

CPU  TIME  USED  74  131  SEC 


TABLE  OF  PROCEDURE 
814-ALLC 
O-ADDCONS 
31 4-ADDLINK 
32-CCOVER 
O-CALCARITH 
1427-FREEGRPH 
O-LSCHOOSE 
5505- NEWC 
15 15-COPYCPX 
10463-SUBG 
32-TRIMM 
69981  CPXCOV 


USE  COUNTS 
69-AQ 

317- ABSOURB 
6935-COSTC 
3538-COSTG 
1024-C0KPMS 
5144-FREECPX 
32-ADDMETA 
1437-NEWG 
1515-COPYGRPH 
477-TRIMC 
461 -TOOSMALL 
204-GEN RLIZ 


93-AQSET 
O-APPLRULES 
O-CLEANCPX 
32 -COVER 
3163-EXTND 

O-SUBCDETAIL 
93-ADDTOMQ 
46 1 'NEVGP 
0-PROCARITH 
285  TR I  MG 
O-VLl 


9-ADDSEL 
O-ADDLRULES 
2 -CLUSTER 
O-COSTL 
1 1060-FRfHTAB 
60-LQST2 
874-NEVCPXTAB 
2-NEVSEEDS 
14642-SVBG1 
O-TRIML 
11-VLINT 


ARITH 

SGVA 

LRULE 

CPXTB 

CPX 

GRAPH 

NEW  COUNTS 

0 

1 

0 

10 

72 

41 

NUMBER  FREE 

- 

- 

_ 

10 

02 

31 

A 

4-j.- 


I 


3 


*V’1. 


£ 


s 

A 
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APPENDIX  C 


CLASSIFYING  TOY  TRAINS 


C.l.  Problem  description 

The  toy  trains  pictured  in  Fig.  7  3  are  described  by  the  following  predicates  and 
functions. 

train  T  contains  car  C 


CCONT(T.C) 


CSHAPE(C) 

the  shape  of  car  C, 

one  of 

•  * 

OPENRECT 

open  rectangle 

' 

OPENTRAP 

open  trapezoid 

US HAP E 

U-shape 

if 

DBLOPNRECT 

double  open  rectangle 

1 

OPENTOP 

any  one  of  the  above  shapes 

HEXAGON 

hexagon 

ELLIPSE 

ellipse 

CLOSEDRECT 

closed  rectangle 

■ 

JAGGEDTOP 

jagged  top  rectangle 

| 

SLOPETOP 

sloping  top  rectangle 

ENGINE 

locomotive 

CLOSEDTOP 

any  of  the  above  shapes 

INFRONT(Cl.C2) 

car 

C'1  is  in  front  of  car  C2 

? 

LN(C') 

the 

length  of  car  C, 

one  of 

*  0 

SHORT 

the  car  is  short 

\  m 
■ 

LONG 

the  car  is  long 

‘if 

LSHAPE(C) 

the 

shape  of  the  cargo  in  car  C,  one  of 

RECTANGLOD 

rectangular  load 

*. 

TRLANGLOD 

triangular  load 

HEXAGONLOD 

hexagonal  load 

-■V 

CIRCLELOD 

circular  load 

£ 

NCAR(T) 

the 

number  of  cars 

in  train  T 

k'A. 


NTL(C) 

NWHL(C) 

WTYPE 


the  number  of  cargo  items  in  car  C 

number  of  wheels  on  each  side  of  car  C 

the  type  of  wheel  on  ear  C,  one  of 

BL  all  wheels  black 

CL  all  wheels  clear 

MXD  a  mixture  of  black  and  clear  wheels 


C.2.  Input  data  file 


TRAINS 

M 

A 

[NCAR(T1 ) =4 . .4] [NVHL (CAR1 ) -2 . .2] [LN (CAR1 ) =SH0RT . .LONG] 

[NPLfCARl ) =1 . .1] [CSHAPE ( CAR 1 ) =OPENRECT , QPENTRAP , USHAPE , DBLOPNRECT , 
HEXAGON . ELLIPSE . CLOSEDRECT . J AGGEDTCP . SLOPETOP . ENGINE] => [D= l ] . 

M 

D 

T 

E 

[CSHAPE=OPENRECT . OPENTRAP , USHAPE . D8L0PNRECT] =  > [CSHAPE=OPENTOP]  . 

E 

[CSHAPE=HEXAGON . ELLIPSE . CLOSEDRECT . JAGGEDTOP . SLOPETOP . ENGINE] 

=> [CSHAPE=CLOSEDTOP] . 


Three  8  lines  are  ueed  to  es¬ 
tablish  the  domains  of  the 
function!  SCAR,  NWHL,  LN, 
NPL,  and  CSHAPE  The  rule 
entered  with  M  and  A  is  delet¬ 
ed  Kith  \f,  D,  and  Y 


The  E  directive  introduce* 
each  value  inference  rule 
The  firet  rule  dcfinei  OPEN- 
TOP  at  a  generalization  of  the 
value >  OPENRECT.  OPEN- 
TRAP.  USHAPE,  and 
DBLOPNRECT  The  eecond 
rule  define s  the  generalized 
value  CLOSEDTOP 


y 
A 

[CC0NTCT1  .CARD]  [CCONT  (T  t  .  CAR2)  ]  [CCONT (T 1 , CAR3 ) ] 

[CC0NT(T1 . CAR4) ] [CCONT (T1 . CAR5] ] 

[NCAR(T1)=5] 

[INFRONT (CAR1 , CAR2) ] [INFRONT (CAR2 . CAR3) ] [INFRONT (CAR3 . CAR4) ] 

[INFR0NT(CAR4 .CARS) ] [NVHLCCARl ) =2] [NVHL(CAR2) =2] [NVHL(CAR3) =2] 

[N'JHL(CAR4)=3]  [NVHL(CARS)  =2]  [WTYPE (CAR1 )  =BK]  [WTYPE (CAR2)  =BK] 

[WTYPE(CAR3)=BK] [WTYPE(CAR4) =BK] [WTYPE(CARS)  =BK] [LN (CAR1 ) =LONG] 

[LN (CAR2) =LONG] [LN (CAR3) =SH0RT] [LN (CAR4) =L0NG] [LN (CARS) =SH0RT] 

[CSHAPE (CAR1 ) =ENGINE] [CSHAPE(CAR2)=0PENRECT] [CSHAPE(CAR3) =SL0PET0P] 

[CSHAPE(CAR4)=0PENRECT] [CSHAPE (CARS) =0PENRECT] 

[NPL (CAR1 ) =0] [NPL(CAR2)=3] [NPL(CAR3) =1] [NPL(CAR4)=l] [NPL(CARS) =1 ] 

[LSHAPE ( CAR2) =RECTANGLOD] [LSHAPE(CAR3) =TRIANGL0D] 

[LSHAPE(CAR4)=HEXAG0NL0D] [LSHAPE(CARS) =CIRCLELOD] 

=  >  [D=l]  . 

N  Thu  deicnption  i*  for  from  B 


Each  train  event  i»  detenbed 
by  a  complex  introduced  with 
the  M  and  A  directive *  Thu 
description  n  for  train  .4  in 
Fig  7  S 


A 

[CCONT  (T1  .CARD]  [CC0NT(T1  .  CAR2)  ]  [CCONT  (Tl  ,  CAR3)  ]  [CCONT  (T1  .  CAR4)  ] 
[NCAR (T 1 ) =4] 


\  t: 


B  £ 


3  /; 


[ I NFRONT ( CAR 1 . CAR2 ) ] [INFRONT (CAH2 , CAR3) ] [INFRONT (CAR3 . CAR4) ] 

[NVHL (CAR1 )  =2]  [NVHL(CAR2)=2]  [NWHL(CAR3)  =2]  [NVHLCCAR4)  =2] 

[•T JPECCARl ) =BK] [VTYPECCAR2) =CL] [UTYPE(CAR3) =CL] (VTYPE(CAR4) =CL] 

[LN (CAR1) =LONG] [LN(CAR2)=SH0RT] [LN (CAR3) =SHORT] [LN (CAR4) =SHORT] 
[CSHAPE(CAR1)=ENGINE] [CSHAPE (CAR2) =USHAPE] [CSHAPE (CARS) =OPENTRAF] 

[CSHAPE (CAR4 ) =CLOSEDRECT] 

[NPL (CAR1 ) =0] [NPLCCAR2) =1] [NPL(CAR3) =1] [NPL (CAR4) =2] 

[LSHAPECCAR2) =TRIANGLOD] [LSHAPECCAR3) =R£CTANGLQD] [LSHAPE (CAR4) =CIRCLELOD] 
=  > [D=l]  . 


Thu  detcription  it  for  (rain  C 


[CC0NT(T1  .CARD]  [CCONT  (Tl ,  CAR2)  ]  [CCONT  (T1  .  CAR3)  ]  [CC0NT(T1  .  CAR4)  ] 

[NCAR(T1)=4] 

[ I NFRONT (CAR  1 .CAR2)]  [INFRONT (CAR2 . CAR3 ) ]  [INFRONT (CAR3 , CAR4) ] 

[N«HL(CAR1 )  =2]  [NVHL(CAR2)=2]  [NUHL(CAR3)  =2]  [N'JHL(CAR4)=3] 

[VTYPE(CARl) =BK] ['.'TYPE (CAR2) =CL] (VTYPE(CAR3) =CL] [VTYFE (CAR4) =CL] 

[LN(CAR1)=L0NG]  [LN (CAR2) =SHORT]  [LN (CAR3) =SHORT]  [LN (CAR4) =LONG] 

[CSHAPE (CAR 1 ) ^ENGINE] [CSHAPE(CAR2) =OPENRECT] [CSHAPE(CAR3) =HEXAGON] 
[CSHAPE(CAR4)=CL0SEDRECT] 

[NPL(CAR1 ) -0] [NPL(CAR2)=l] [NPL(CAR3) =1] [NPL(CAR4) =1] 

[ LSHAPE (CAR2) =CIRCLEL0D] [LSHAPE(CAR3) =TRIANGLOD] [LSHAPE (CAR4) =TRIANGLOD] 

=  >  [0  =  1]  . 

N  Thu  detcription  i$  for  train  D 


[CC0NT(T1  .CARD]  [CCONT  (T 1  .  CAR2)  ]  [CCONT  (Tl  .CAR3)  ]  [CCONT (Tl . CAR4) ]  [CCONT  (Tl  .  CARS)  ] 
[NCAR(TD=5] 

[INFRONT (CAR1 , CAR2) ] [INFRONT (CAR2 . CAR3) ] [INFRONT (CAR3 . CAR4) ] [INFRONT (CAR4 . CARS) ] 
[NVHL(CAR1)=2]  [NVHL(CAR2)  =2]  [NVHL(CAR3) =2]  [N'.’HL(CAR4)  =2]  [NVHL (CARS)  =2] 
[VTYPE(CAR1)=CL]  [VTYPE(CAR2)  =CL]  [VTYPE(CAR3)  =CL]  [VTYPE(CAR4) =CL]  [’.'TYPE ( CARS )  =CL] 
[LN (CAR1 ) =LONG] [LN (CAR2) =SHORT] [LN (CAR3) =SHORT] [LN (CAR4) =SHORT] [LN (CARS) =SHORT] 
[CSHAPE(CAR1 ) =ENGINE] [CSHAPE(CAR2) =OPENTRAP] [CSHAPE (CAR3) =DBLOPNRECT] 
[CSHAPE(CAR4) = ELLIPSE] [CSHAPE (CAR6) =OPENRECT] 

[NPL(CAR1)=0] [NPL(CAR2)  =  1] [NPL(CAR3) =1 ] [NPL(CAR4) =1] [NPL(CARS) =1) 

[LSHAPE (CAR2)=TRIANGL0D] [LSHAPE (CAR3) =TRIANGLOD] [LSHAPE (CAR4) =RECTANGLOD] 

[LSHAPE (CARS) =RECTANGLOD] 

=  >  [D=l]  . 


Thu  detcription  it  for  train  E 


[CCONT  (Tl  .CARD]  [CCONT  (Tl .  CAR2)  ]  (CCONT  (Tl  .  CAR3)  ]  [CCONT  (Tl  .  CAR4)  ] 

[NCAR (T 1 ) =4] 

[ I NFRONT (CAR1.CAR2)] [INFRONT (CAR2 . CAR3) ] [INFRONT (CAR3 . CAR4) ] 

[NVHL  (CARD -2] [NVHL(CAR2) =2] [NUHL (CAR3) =3] [NVHL  (CAR4)  =2] 

[VTYPE(CAR1)=«XD]  [VTYPE(CAR2)=BK]  [VTYPE  (CAR3)  =BK]  [VTYPE(CAR4)  =BK] 

[LN (CAR1 ) =LONG] [LN (CAR2) =SHORT] (LN (CAR3) =LONG] [LN (CAR4) =SHORT] 

[CSHAPE (C AR 1 ) =ENGINE] [CSHAPE (CAR2) =DBLOPNRECT] [CSHAPE(CAR3) =CLOSEDRECT] 

[CSHAPE(CAR4) =CLOSEDRECT] 

[NPL(CAR1)=0] [NPL(CAR2)=1] (NPL(CAR3) =l] (NPL(CAR4) =1] 

[LSHAPE (CAR2)=TRIANGL0D] [LSHAPE (CAR3) =RECTANGLOD] [LSHAPE (CAR4) =CIRCLELOD] 

=  >[D=1]  . 

M  Thu  detcription  u  for  train  F 


[CCONT  (Tl  .CARD]  [CCONT  (Tl .  CAR2)  ]  [CCONT  (Tl  ,  CAR3)  ] 


[NCAR(TD  =3] 

[INFR0NT(CAR1 . CAR2) ] [INFRONT (CAR2 . CAR3) ] 

[NUHL(CARD=2] [NUHL(CAR2) =2] [NUHL(CAR3) =2] 

['.'TYPE  (CARD =BK] [UTYPE(CAR2)=CL] [UTYPE (CAR3) =CL] 

[LN (CAR1 ) =L0NG] [LN (CAR2) -LONG] [LN (CAR3) =SHORT] 

[CSHAPE ( CAR D  =ENG I NE] [CSHAPE (CAR2) =CLOSEDRECT] [CSHAPE (CAR3) =0PENRECT] 

[NPL(CAR1)=0] [NPL(CAR2)=3] [NPL(CAR3) =1] 

[LSHAPE(CAR2) =CIRCLELOD] [LSHAPE(CAR3) =TRIANGLOD] 

=  >[D=1]  . 

M  This  description  is  / or  train 

A  G 

[CCCNT(T1  .CAR1)]  [CCONT  (T1  ,CAR2)  ]  [CC0NTCT1  . CAR3)  ]  [CCONT  (T1  .  CARO  ] 

-  [NCAR(TD  =4] 

[INFRONT (CAR1 , CAR2) ]  [INFRONT (CAR2 . CAR3) ]  [INFRONT (CAR3 . CAA4) ] 

[NUHL(CARl) =2] [NUHL(CAR2)=2] [NUHL(CAR3) =2] [NUHLCCAR4) =2] 

[UTYPE (CAR1 )  =CL]  [UTYPE(CAR2)  =8K]  [UTYPE  ( CAR3 )  =CL]  [UTYFE(CAR4) =CL] 

[LN(CARD=LONG] [LN (CAR2) =SHORT] [LN (CAR3) =SH0RT] [LN (CAR4) =LONG] 

[CSHAPE(CAR1)=ENGINE] [CSHAPE (CAR2) =D8L0PNRECT] [CSHAPE(CAR3) =USHAPE] 

[CSHAPE (CAR4)=JAGGEDT0P] 

[NPL(CAR1 ) =0] [NPL  (CAR2)  =  D [NPL (CAR3) = 1 ] [NPL (CAR4) =0] 

[LSHAPL (CAR2) =CIRCLELOD] [LSHAPECCAR3) =TRIANGLOD] 

=  >  [D=l]  . 

M  This  description  is  for  train  H 


A 

[CCONT (T1  .CARD]  [CC0NTCT1  . CAR2)  ]  [CCONT (T1 . CAR3) ] 

[NCAR (T1 ) =3] 

[INFRONT (CAR1 . CAR2] ] [INFRONT (CAR2 . CAR3) ] 

[NUHL(CARD=2]  [NUHL(CAR2)=3]  [NUHL(CAR3) =2] 

[UTYPECCARl )  =CL]  [.'TYPE (CAR2)  =CL]  [UTYPE(CAR3) =CL] 

[LN (CAR1 ) =LONG] [LN (CAR2) =LONG] [LN (CAR3) =SHORT] 

[CSHAPE(CARD=ENGINE]  [CSHAPE (CAR2)  =CLOSEDRECT]  [CSHAPE (CAR3) =USHAPE] 

[NPL (CAR1 ) =0] [NPL (CAR2) = 1 ] [NPL(CAR3) = 1 ] 

[LSHAPE (CAR2) =RECTANGLOD] [LSHAPE (CAR3) =CIRCLELOD] 

*>[D«1]  . 

N  This  description  is  for  train  I 

A 

[CCONT  CT 1  .CARD]  [CCONT  (T1  .  CAR2)  ]  [CCONT  (T1 ,  CAR3)  ]  [CCONT  (T  l .  CAR4)  ]  [CCONT  (T1 .  CARS)  ] 
[NCAR(TD=6] 

[INFRONT (CAR1 . CAR2) ] [INFRONT (CAR2 , CAR3) ] [INFRONT (CAR3 , CAR4) ] [ INFRONT (CAR4 . CARS) ] 

[N’UHL (CARD  =2]  [NUHL(CAR2)=2]  [NUHL(CAR3)  =2]  [NUHLCCAR4)  =2]  [NUHL(CARS)  =2] 

[UTYPECCARl ) =CL] [UTYPE(CAR2) =CL] [UTYPE(CAR3)  =CL] [VTYPE(CAR4) =CL] [UTYPE (CAR6) =CL] 
[LN(CARD=LONG]  [LN  (CAR2)  =SHORT]  [LN(CAR3)  =LONG]  [LN (CAR4) =SHORT]  [LN (CARS) =SHORT] 

[CSHAPE (CARD  =ENGINE]  [CSHAPE (CAR2)  =OPENTRAP]  [CSHAPE (CAR3)  =JAGGEDTOP] 
[CSHAPE(CAR4)=0PENRECT] [CSHAPE (CARS) =OPENTRAP] 

[NPL (CARD  =0]  [NPL(CAR2)  =1]  [NPL(CAR3)  =  D  [NPL(CAR4)=D  [NPL(CAR6)=D 
[LSHAPE(CAR2)=CIRCLEL0D] [LSHAPE(CAR3) =RECTANGLOD] [LSHAPE (CAR4) =RECTANGLOD] 

[LSHAPE(CARS) =CIRCL£LOD] 

=>[d=D  . 

H  This  description  is  /or  (rain  J 

A 

[CCONT (T1  .CARD]  [CCONT (T1  .CAR2)  ]  [CCONT (T1 . CAR3)  ] 

[NCAR(TD=3] 
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?  v< 


VI 


*7 

*5 


[INFR0NTCCAR1.CAR2)] [INFRCNT (CAR2 . CAR3) ] 

[N'«'HL(CAR1 )  =2]  [NVIHLCCAR2)  =2]  [NVHL(CAR3) =2] 

[VTYFECCAR1 )  =CL]  [«TYPE(CAR2)  =CL]  [Wrr?E(CAB3)  =CL] 

[LN (CAR1 ) =LONG] [LN (CAR2) -SHORT] [LN (CAR3) =LQNG] 

[CSHAPE (CAR 1 ) =ENGINE] [CSHAPECCAR2) =USHAPE] [CSHAPE (CAR3) -OPENRECT] 
[NPL(CAR1)=0]  [NPLCCAR2)  =  1]  [NPL(CAR3) =2] 

[LSHAPE(CAR2)=R£CTANGL0D] [LSHAPE(CAR3) =RECTANGLOD] 

=  >  U5=l]  . 

P 

EXTMTY 

EQUIV 

YETATRIM  99 
ALTER  6 
VL.YAXSTAR  4 
VLNF  2 
VLCRIT(l)  -1 
VLCRIT (2)  -2 
VLTOL(l)  0 
VLT0LC2)  0 
DESCTYPE  CHAR 
PA 
QUIT 


C.3.  Results  from  structural  template  generation 


INDUCE  3  -  VERSION  AS  OF  AUGUST  25  1984 


THIS  RUN  "ADE  ON  84/09  18 
INITIALIZING  (MTRAINS) 


VARIABLE  NAME  VTYPE 

VCOST 

TRACE  3  10 

*PT 

LIN 

1 

STOPS 

*P 

LIN 

1 

PRINT  RULES 

TRUE 

sDIFF 

LIN 

t 

NCAR 

LIN 

I 

NWHL 

LIN 

1 

LN 

LIN 

1 

NPL 

LIN 

1 

CSHAPE 

STR 

1 

PARAMETERS  GENERAL 

VL 

" 

AQ 

L-RULE 

REGENSTAR  1 

VLMAXSTAR 

4 

AQYAXSTAR 

2  MAXL  ! 

METATRIM 

99 

NCONSIST 

4 

AQCUTFI 

20 

DESCTYPE 

CHAR 

ALTER 

5 

LQST  FALSE 

EXTMTY 

TRUE 

M INCOVER 

100 

EQUIV 

TRUE 

MAXBACK 

0 

VLNF =3 
CRITERION.  VLCRIT 


AQNF=2 

AQCRIT 


LRNF=4 
AQTOL  LRCRIT 


That  parameter  settings  en¬ 
able  the  construction  oj  selec¬ 
tors  by  application  of  counting 
quantified  variables,  counting 
similar  selectors,  counting 
distinct  values,  universal  pro¬ 
perties.  chain  properties,  and 
equivalence  properties 

transformations  (see  Sec 
4  t)  The  last  two  transforma¬ 
tions  are  enabled  by  the 
EXT.UTY  and  EQUIV  direc¬ 
tives,  respectively  The  other 
transformations  are  enabled 
by  the  META  TRIM  directive 
The  DESCTYPE  CHAR  direc¬ 
tive  causes  the  progi-om  to 
build  a  structural  template 
charactencalion 


This  report  gives  the  names  of 
functions  which  have  a 
domain  which  is  not  nominal 
The  VT\TE  code  UN  denotes 
a  linear  domain,  the  code  STR 
denotes  a  structured  domain 
with  a  value  hierarchy 


This  report  gives  the  values  of 
control  parameters 


This  report  shows  the  evalua¬ 
tion  criterion  LEF  com¬ 
ponents  The  most  important 


mmm 


wm 
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ENTER  ONE  CHAR  (P) ARAMETERS,  (V)Lt.  (C)OVER.  (M)OOIFY,  (H)ELP  FOR  OPTIONS 


WHAT  EVENT  SET  DO  YOU  WANT  TO  COVER7 

ENTER  NUMBER  OR  SYMBOLIC  VALUE  OF  DECISION  VARIABLE 


NOW  COVERING  EVENT  SET  l 

THE  FOLLOWING  RULES  COVER  SET  1 

THIS  RULE  COVERS  EVENTS  13  12  1 1  10  9  8  7  6  5  4  (10  NEW) 

RULE  489  EVENT  SETS  1,  COSTS (  3-1  2)  0  -10  84 

[CC0NTCT1  .CARO]  [CCONT (T1 . CAR2) j  [CCONT (T 1  .CAR3)  !  [CSHAPE(CAR1 )  =ENS INE] 
[CSHAPE(CAR2)*HEXAG0N]  :CSHAPE(CAR3) SELL  IPSE]  [FORALL-CARS (NPL-3) -FALSE) 

[ FORALL-CARS (CSHAPE-OPENRECT)=FALS£]  [FORALL-CARS (CSHAPE=OPENTRAP) rFALSE! 

' FORALL-CARS(CSHAPE=USHAPED) =FALSE; [ FORALL-CARS (CSHAPE=DBLOPNRECT) = FALSE] 
[FORALL-CARS(CSHAPE=HEXAGON)=FALSE]  [FORALL-CARS  (CSHAPE=ELL IPSE) = FALSE] 
[FORALL-CARS (CSHAPE^CLOSEDRECT) =FALSE]  [FORALL-CARS(CSHAPE= JAGCEDTOP) -  FALSE] 

[ FORALL-CARS (CSHAPE- SLOPETOP) =FALSE] [ FORALL-CARS (CSH APE- ENGINE) = FALSE] 
[FORALL-CARS (CSHAPE=OPEN TOP) =FALSE] [FORALL-CARS (CSHAPE=CLOSEDTOP) -FALSE] 
[FORALL-CARS (WTYPE=MXD) =FALSE]  [FORALL-CARS (LSHAPE =  TRIANGLOD) =FALSE] 
FORALL-CARS (LSHAPE-HEXAGONLOD) =FALSE] [FORALL  CARS (LSHAPE- Cl RCLELOD) -FALSE! 
[FORALL-CARS (NWHL=3) =FALSE] [ FORALL-CARS (LN-SHQRT) = FALSE] 

[FORALL-CARS (LN^LONG) -FALSE!  [FORALL-CARS (NPL -0) ~  FALSE] 

[FORALL-CARS (NPL= 1 ) -FALSE] [FORALL-CARS (NPL  2)  FALSE! [ INFRONT (CAR2 . CAR3) 1 
[  INFRONT (CAR1  .CAR2)  ]  [ LN (CAR1 )  =LONG]  [LN(CAR2)=*]  [LHCCAR3D*] 

[ LSHAPE (CAR2)»HEXAG0NL0D) [LSHAPECCAR3) »HD(AGONLOD] [ MST- INFRON (CAR1 ) ] 

[ NCAR (T 1 ) =3  5] [NPLCCARl ) =0] [ NPL(CAR2) SO; [NPL(CAR3)=t  2] [NVHLCCARl ) =2] 

[NVHL(CAR2)=2  3] [NWHL (CAR3) =2  3] [WTYPE(CAR1 )=•] [WTYPE(CAR2) SMXD ] 

[VTYPE(CAR3)#MXD3  [SCARS (CSHAPE=HEXAG0N)-0  1 ][ sCARS (CSHAPE-ELLIPSE) -0  1] 

[ SCARS (CSHAPE=CL0SEDRECT)=0  2] [sCARS(CSHAPE= JAGGEDTOP) =0  l] 

[ SCARS (CSHAPE=SL0PET0P)=0  l] [ sCARS (CSHAPE- ENG INE) = l ] 

[ SCARS (CSHAPE=0PENT0P)=1  3] t*CARS(CSHAPE=CLOSEDTOP) = l  3] 

[ SCARS (C3HAPE=0PENRECT)S4  5] [*CARS(CSHAPE=OPENTRAP) ^0  2] 

[ SCARS  (CSHAPE=USHAPED)=0  1] ( SCARS (CSHAPE^DBLOPNRECT) =0  1]  [sCARS(LN=SHORT) a 

[SCARS (LN=L0NG)=1  3] [ sCARS (LSHAPE^ RECTANCLOD ) =0  2] 

( SCARS (LSHAPE= TRIANGLOD) =0  2] [ SCARS (LSHAPE-HEXAGONLOD) =0  1] 

[ sCARS (LSHAPE=CIRCLELOD)rO  2] [sCARS (NPL=0) = 1  2] [ sCARS (NPL  = 1) so , 5! 

[ SCARS (NPL=2)=0  1 ][ SCARS (NPL=3) =0  1 ][ sCARS (NWHL=2) #0  1] [ SCARS (NWHL-3) -0 

[ sCARS (WTYPE=MXD)=0  l![sCARS=3  5] [sOIFF-CSHAPE=3  5] [*DIFF-LN'2l 
(*DIFF-LSHAPEs0.5i  [ sDIFF-NCAR=  t ]  [sDIFF-NPL=2  3]  [ sDIFF-NWHL= 1  2] 

[sDIFF-VTYPE= 1  2] [«TS(NCAR=5) =0  1 ] [tf TS (NCAR-3) =0  i ] ( *TS(NCAR=4) =0  l][sTS 

ENTER  ONE  CHAR  (P) ARAMETERS .  (V)L1.  (C)OVER.  (M)ODIFY,  (H)EU5  FOR  OPTIONS 

’  q 


CPU  TIME  USED  89  574  SEC 


LEF  i«  the  one  at  the  IT  lev¬ 
el.  under  the  column  with  the 
VL CRl T  heading  Criterion 
-1  maximize#  the  number  of 
event #  covered  Criterion  -C 
maximize#  the  number  of  of 
selectors  in  the  complex  (to  re¬ 
quest  that  the  complex  be  max¬ 
imally  specific j 

The  c  response  requests  a 
characteristic  cover  of  the 
events 

All  events  are  input  as 
members  of  class  l 

Alt  10  trains  are  covered  by 
this  characteristic  descrip¬ 
tion  This  structural  template 
binds  some  of  the  quantified 
variables  to  certain  parts  of 
objects  Predicates  and  func¬ 
tions  which  take  different 
values  in  at  least  two  events 
are  used  to  build  a  derived 
af<ri6ute-6a#e<rf  description, 
shown  below  in  Sec  C  4 


TABLE  OF  PROCEDURE 
10-ALLC 
O-ADDCONS 
958-ADDLINK 
O-CCOVER 
O-CALCARITH 
488-FREEGRPH 
i-LSCHOOSE 
507-NEWC 
486-COPYCPX 
7866-SUBG 


USE  COUNTS 
O-AQ 

26-ABSOURB 
O-COSTC 
I 323-COSTG 
69-COMP MS 
488-FREECPX 
1 -ADDMETA 
499-NEWG 
486-COPYGRPH 
O-TRIMC 


The  above  template  descrip¬ 
tion  I#  all  that  i#  needed  from 

INDUCE/ 9 

About  82  seconds  of  CPU  lime 
on  a  Cy6er  175  was  needed  to 
build  the  structural  template 


I-AQSET 
1  - APPLRULES 
O-CLEANCPX 
1- COVER 
O-EXTND 
O-SUBGDETAIL 
1 -ADDTOMQ 
93-NEWGP 
O-PROCARITH 
25-TRIMG 


10-ADDSET 
O-ADDLRULES 
O-CLUSTER 
O-COSTL 
10I3-FREETAB 
10-LQST2 
20-NEWCPXTAB 
O-NE*  SEEDS 
14753-SUBG1 
O-TRIML 


w 
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l-TRIMM 

O-CPXCOV 


ARITH 

NETi  COUNTS  0 

NUMBER  FREE 


93-TOOSVALL  O-VU 

66-GEJiRLlZ 


SG-A 

LRULE 

CPXTB 

CPX 

GRAPH 

1 

0 

1 1 

34 

34 

- 

- 

11 

23 

23 

13-VLINT 


C.4.  Attributes  derived  from  template  matching 


The  following  tables  of  51  attribute  values  for  each  of  the  10  trains  were  derived 
by  matching  the  above  structural  characterization  template  to  the  events.  In  the  tables, 
attributes  derived  from  predicates  take  the  values  0  and  1  to  denote  FALSE  and  TRUE, 
respectively.  Here,  event  numbers  1  to  10  correspond  to  trains  A  to  J,  respectively. 


EVENTS 

9  CSHAPE2  CSHAPE3  FAN«HL2  FAVTYPEBK  FAWTYPECL  FALSHAPERECT  LN2  LN3  LSHAPE2 


1  OPENRECT  SL0PET0P  0  1 

2  USHAPE  OP ENTRAP  I  0 

3  OPENRECT  HEXAGON  0  0 

4  OPEN TRAP  DBLOPRECT  l  0 

5  DBLOPRECT  CLOSEDRECT  0  0 

6  CLOSEDRECT  OPENRECT  1  0 

7  DBLOPRECT  USHAPE  1  0 

8  CLOSEDRECT  USHAPE  0  0 

9  OPENTRAP  JAGGEDTOP  i  0 

10  USHAPE  OPENRECT  I  0 


LONG 

SHORT 

SHORT 

SHORT 

SHORT 

LONG 

SHORT 

LONG 

SHORT 

SHORT 


SHORT 

SHORT 

SHORT 

SHORT 

LONG 

SHORT 

SHORT 

SHORT 

LONG 

LONG 


RECTLOD 

TRILOD 

CIRLOD 

TRILOD 

TRILOD 

CIRLOD 

CIRLOD 

RECTLOD 

CIRLOD 

RECTLOD 


The  attribute  names  are  ab - 
breviated  The  leading  FA 
denotes  - forail '  It  is  followed 
by  the  property,  written 
without  punctuation  or  equals 
sign ,  e  g  .  FASWHL2  denotes 
* forail  cars  number  of  wheels 
equals  2'  On  attribute  names 
not  beginning  with  FA.  an 
ending  numeral  denotes  the 
car  number,  eg.  2  denotes 
ear?  as  in  CSHAPE2 


EVENTS 


The  abbreviation  beginning 


9  LSHAPE3 

NCAR 

NPL2 

NPL3 

NVHL2  SAVDC.HU  23  SAYC.TYPE123  WTYPE3 

VTYPEI 

VTYPE2 

with  SAME  denotes  a  ‘same' 

1  TRILOD 

5 

3 

1 

2 

1 

1 

BtC 

8fC 

BK 

predicate  Ending  numerals 

2  RECTLOD 

4 

1 

1 

2 

i 

0 

CL 

BK 

CL 

denote  the  arguments,  e  g  . 

3  TRILOD 

4 

1 

1 

2 

1 

0 

CL 

BK 

CL 

SAMENWHLI23  denotes 

4  TRILOD 

5 

1 

I 

2 

1 

1 

CL 

CL 

CL 

* same  number  of  wheels  for 

5  RECTLOD 

4 

1 

1 

2 

0 

0 

BK 

MXD 

BK 

carl,  car 2,  and  carl*  SCAR 

6  TRILOD 

3 

3 

1 

2 

l 

0 

CL 

BK 

CL 

stands  for  * number  of  cars  in 

7  TRILOD 

4 

1 

1 

2 

l 

0 

CL 

CL 

BK 

the  train' 

8  CIRLOD 

3 

1 

1 

3 

0 

1 

CL 

CL 

CL 

9  RECTLOD 

5 

1 

1 

2 

l 

1 

CL 

CL 

CL 

10  RECTLOD 

3 

1 

2 

2 

1 

1 

CL 

CL 

CL 

EVENTS 

The  abbreviation  beginning 

9  NCARSCLOSDREC 

NCARS JAGGED  NCARSSLOPE 

NCARSOPENTOP 

NCARSCLOS 

DTOP 

SCARS  denotes  the  number  of 

l  0 

0 

l 

3 

2 

cars  with  the  particular  pro¬ 

2  l 

0 

0 

2 

2 

perty  coded  in  the  remainder 

3  1 

0 

0 

1 

3 

of  the  attribute  name  These 

4  0 

0 

0 

3 

2 

attributes  here  give  the 

5  2 

0 

0 

1 

3 

numbers  of  cars  with  particu¬ 

6  1 

0 

0 

1 

2 

lar  car  shapes. 

7  0 

1 

0 

2 

2 

8  1 

0 

0 

1 

2 

9  0 

l 

0 

3 

2 

10  0 

0 

0 

2 

1 

EVENTS 


9 

NCARSOPENREC 

NCARSOPENTRAP 

NCARSUSHAPE 

NCARSDBLOPREC 

NCARSHEXAGON 

1 

3 

0 

0 

0 

0 

2 

0 

l 

1 

0 

0 

3 

1 

0 

0 

0 

1 

4 

1 

1 

0 

1 

0 

5 

0 

0 

0 

1 

0 

6 

1 

0 

0 

0 

0 

7 

0 

0 

1 

1 

0 

8 

0 

0 

1 

0 

0 

9 

1 

2 

0 

0 

0 

This  table  continues  giving  at¬ 
tributes  involving  the  number 
of  cars  of  a  particular  shape 


EVENTS 

s  NCARSELLIPSE  NCAftSSHORT  NCARSLONG  NCARSHEXLOD  NCARSCIRLOD  NCARSRECTLOD 


The  attribute »  XCARSSHORT 
and  \’CARSLO.\'C  give  the 
number  of  short  and  long  cars 
respectively  The  attributes 
ending  in  LOD  give  the 
number  of  cars  carrying  vari¬ 
ous  shapes  of  cargo  (loads/ 


EVENTS 

3  NCARS7RILOD 
1 


1 

3 

4 

5 

6 

7 

8 

9 

10 


NCARSNPL2 

0 

3 

0 

0 

0 

0 

0 

0 

1 


NCARSNPL3  NCARSNPLO  NCARSNPL 1  NCARSNVHL2  NCARSNWHL3 


The  attributes  ending  WPLO 
SPLl  SPL2,  MPLS  give  the 
number  of  cars  carrying  0  I. 
2,  and  9  units  of  cargo 
respectively  The  attributes 
ending  i\\VffL2  and  \\YHL2 
give  the  number  of  cars  with  2 
and  9  wheels  (on  one  side/, 
respectively 


EVENTS 

a  NCARSVTYPE.VXD  NCARS«TYPECL  NCARSWTYPEBK  DIFFCSHAPE  DIFFLSHAPE  DIFFNPL 


1 

2 

3 

4 

5 
8 

7 

8 

9 

10 


The  attributes  involving 
W  T  YPEMXD,  VV  T  YPE  CL . 
and  WTYPEDK  give  the 
number  of  cars  that  have 
mixed  all  clear  and  all  black 
wheels,  respectively  The  ab¬ 
breviation  DIFF  is  used  on  at¬ 
tributes  that  give  the  number 
of  different  values  for  a  func¬ 
tion  used  to  describe  a  partic¬ 
ular  train 


EVENTS 

a  DIFFNVHL  DIFFVTYPE  LST INFR0NT3 


1 

2 

3 

4 

5 

6 

7 

8 

9 

10 


The  attribute  LSTl.VFRON 79 
if  derived  from  the  LEAST- 
i  nfront  predicate  (LST- 
IXFRON/  evaluated  for  carS 
In  trains  6.  9.  and  10.  carS  if 
the  end  car  represented  by  a 
true  ( t /  value  for  this  attri¬ 
bute 


C.5.  Attributes  added  to  describe  structural  fragments 

As  described  in  Sec.  7.3,  seven  attributes  are  added  to  describe  structural  units  in 
the  trains  not  covered  by  the  structural  template.  The  first  attribute  gives  the  number 
of  one-car  additions  attached  to  car3.  This  attribute  is  called  #lat3'.  The  second 
attribute  gives  the  number  of  two-car  additions  attached  to  car3.  It  is  called  #‘2at3'. 
The  remaining  5  attributes  are  conditional  attributes  which  describe  the  part  attached  to 
car3  (which  is  called  carl  for  convenience).  The  value  UNK  (unknowable)  is  used  when 
a  train  does  not  contain  any  part  taking  the  role  of  carl. 


EVENTS 


s 

s  lit 3 

»2lt3 

CSHAPE4 

LSHAPE4 

NPL4 

NWHL4 

WTYPE4 

1 

0 

1 

OPENRECT 

HEXLOD 

1 

3 

BK 

2 

1 

0 

CLOSDRECT 

CIRLOD 

2 

2 

CL 

3 

1 

0 

CLOSDRECT 

TRILOD 

1 

3 

CL 

4 

0 

1 

ELLIPSE 

RECTLOD 

1 

2 

CL 

5 

1 

0 

CLOSDRECT 

CIRLOD 

1 

2 

BK 

6 

0 

0 

UNK 

UNK 

UNK 

UNK 

UNK 

7 

1 

0 

JAGGEDTOP 

UNK 

0 

2 

CL 

8 

0 

0 

UNK 

UNK 

UNK 

UNK 

UNK 

9 

0 

l 

OPENRECT 

RECTLOD 

1 

2 

CL 

10 

0 

0 

UNK 

UNK 

UNK 

UNK 

UNK 

C.6.  Input  file  for  attribute-based  clustering 

The  following  specifications  are  input  data  for  the  attribute-based  clustering  program 
CLl’STER/2.  The  input  file  consists  of  the  following  declarative  statements  (in  the  form 
of  relational  tables)  plus  the  attribute-based  event  descriptions,  as  shown  above.  Since 
th e  above  tables  of  attribute  values  are  shown  in  the  format  used  by  CLl’STER/2,  they 
are  not  duplicated  in  the  listing  of  the  input  file.  A  comment  at  the  end  of  the  input 
file  listing  shows  where  the  event  descriptions  (in  table  form)  are  normally  placed. 

MAINTITLE  •CLUSTERING  TRAINS  USING  58  DERIVED  ATTRIBUTES* 


PARAMETERS 

TRACE  CRITERION  NIDSPEED  COVERTYPE  BASE  PROBE  HI  H2  H3  K 
OFF  OS  SLOW  DISJOINT  2  20  4  4  4  2 


DS-CRITERION 
3  CRITERION  TOLERANCE 

1  -COM  0  95 

2  DIM  0  0 


VARIABLES 


3 

NAME 

TYPE 

1 

CSHAPE2 

STR 

2 

CSHAPE3 

STR 

3 

FANVHL2 

NOM 

4 

FAW'TYFEBK 

NOM 

5 

FA*TYPECL 

NOM 

LEVELS 

5 

8 


These  parameters  request  a 
clustering  into  two  classes 
The  PROBE  value  is  set  large 
120)  to  extend  the  search  for 
good  clusterings  to  improve 
the  results 

The  clustering  criterion  LEF 
is  to  minimize  the  number  of 
selectors  (negative  eommonal - 
I tyj  and  then  maximize  the 
dimensionality  (number  of 
discriminant  variables j  The 
tolerance  the  first  criterion 
is  set  very  large  at  95*0  It  •# 
used  to  screen  out  exception - 
ally  specific  clusterings  (e  g  . 
a  singleton  cluster  and  a  9- 
event  cluster)  which  have  high 
dimensionality  scores  but  are 
really  not  very  interesting 

The  VARIABLES  (attributes) 
table  gives  the  type  and 
number  of  values  in  the 
domain  of  each  attribute 
SOM  denotes  a  nominal 
domain.  LIS  denotes  a  linear 
domain.  STR  denotes  a  struc- 


4 

5 


2 


0 

7 

FALSHAP  ERECT 

LN2 

NOM 

NOM 

2 

2 

tured  domain  with  a  value 
hierarchy 

8 

LN3 

NOM 

2 

9 

LSHAPE2 

NOM 

3 

10 

LSHAPE3 

NOM 

3 

1 1 

NCAR 

LIN 

3 

12 

NPL2 

NOM 

2 

13 

NPL3 

NOM 

2 

14 

NVHL2 

NOM 

o 

15 

SAMENVHL123 

NOM 

2 

to 

SAME:- TYPE  123 

NOM 

2 

17 

WTYPE3 

NOM 

2 

18 

WTYPEl 

NOM 

3 

19 

VTYPE2 

NOM 

2 

20 

NCARSCLOSDREC 

LIN 

3 

21 

NCARS JAGGED 

NOM 

2 

22 

NCARSSLOPE 

NOM 

2 

23 

NCARSOPENTOP 

LIN 

3 

24 

NCARSCLOSDTOP 

LIN 

3 

25 

NCARSOPENREC 

LIN 

4 

20 

NCARSOPENTRAP 

LIN 

3 

27 

NCARSUSHAPE 

NOM 

2 

28 

NCARSDBLOPREC 

NOM 

2 

29 

NCARSHEXAGON 

NOM 

2 

30 

MCARSELLIPSE 

NOM 

2 

31 

NCARSSHORT 

LIN 

4 

32 

NCARSLONG 

LIN 

3 

33 

NCAREHEXLOD 

NOM 

2 

34 

NCARSCIRLOD 

LIN 

3 

35 

NCARS RECTLOD 

LIN 

3 

38 

NCARSTRILOD 

LIN 

3 

37 

NCARSNPL2 

LIN 

4 

38 

NCARSNPL3 

NOM 

2 

39 

NCARSNPLO 

NOM 

2 

40 

NCARSNPLl 

LIN 

4 

41 

NCARSNVHL2 

LIN 

4 

42 

NCARSNVHL3 

NOM 

2 

43 

NCARSVTYPEMXD 

NOM 

2 

44 

NCARoWTYPECL 

LIN 

6 

45 

NCARS'-fTYPEBK 

LIN 

0 

46 

D IFFCSHAPE 

LIN 

3 

47 

DIFFLSHAPE 

LIN 

4 

48 

DIFFNPL 

NOM 

2 

49 

DIFFNWHL 

NOM 

2 

50 

DIFF'.TYPE 

NOM 

2 

51 

LSTINFR0NT3 

NOM 

2 

52 

aiit3 

NOM 

2 

53 

«2at,3 

NOM 

2 

54 

CSHAPE4 

STR 

5 

55 

LSHAPE4 

SIR 

5 

58 

NPL4 

STR 

4 

i%*  ■,*  *•  v« 

•  ,  “  . 
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57  N«HL4  STR  3 

58  -TYPE4  STR  3 

CSHAPE2  NAMES 
VALUE  NAME 

0  OPENRECT 

1  USHAPE 

2  OPENTRAP 

3  DBLOPRECT 

4  CLOSEDRECT 

C.^HAPES- STRUCTURE 

NAME  SUBNAME  SUBNAME 
OPENTOP  OPENRECT  USHAPE 
CLOSTOP  CLOSEDRECT  $ 

CSHAPE3-NA.MES 
VALUE  NAME 

0  SLOPETOP 

1  OPENTRAP 

2  HEXAGON 

3  DBLOPRECT 

4  CLOSEDRECT 

5  OPENRECT 

6  USHAPE 

7  JAGGEDTOP 

CSHAPE3- STRUCTURE 
NAME  SUBNAME  SUBNAME  SUBNAME  SUBNAME 

OPENTOP  OPENTfUP  DBLOPRECT  OPENRECT  USHAPE 

CLOSTOP  SLOPETOP  HEXAGON  CLOSEDRECT  JAGGEDTOP 

LN2- NAMES 
VALUE  NAME 
0  SHORT 

1  LONG 


SUBNAME  SUBNAME 

OPENTRAP  DBLOPRECT 

$  $ 


LN3-NAMES 
value  name 

0  SHORT 

1  LONG 

LSHAPE2- NAMES 
VALUE  NAME 
0  RECTLOD 

1  TRILOD 

2  CIRLOD 

LSHAPE3- NAMES 
VALUE  NAME 
0  TRILOD 

1  RECTLOD 


The  following  tables  called  4 
•  SAMES9  are  used  to  map  the 
values  in  a  domain  with  d 
values  to  the  integers  0  to  d- 1 
The  tables  called  ‘  - STRL'C - 
TLTtE*  define  the  value 
hierarchy  for  a  structured 
domain  In  such  tables,  the 
values  under  the  SCBSAME 
headings  may  be  generalized 
to  the  value  under  the  SAME 
heading  The  $  i  so  null  entry 
used  as  a  place  holder 


!*■  Mill  I  '  ■!'  •> 
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CIRLOD 


NCAR-NAMES 
VALUE  NAME 
0  3 

1  4 

2  5 


1 


NPL2-NAMES 
VALUE  NAME 
0  1 

1  3 

NPL3-NAMES 
VALUE  NAME 
0  1 

1  2 


NVHL2-NA.MES 
VALUE  NAME 
0  2 

1  3 

VTYPE3- NAMES 
VALUE  NAME 
0  BK 

1  CL 

VTYPE1 -NAMES 
VALUE  NAME 
0  BK 

1  CL 

2  MXD 

UTYPE2- NAMES 
VALUE  NAME 
0  BK 

1  CL 


NCARSOPENTOP - NAMES 
VALUE  NAME 
0  1 

1  2 

2  3 


NCARSCLOSD TOP - NAMES 
VALUE  NAME 
0  1 

1  2 

2  3 


8 

I 


R 

§ 

S 


1 

8 


% 


1 

I 

R 

I 


VALUE  NAME 
0  1 

1  2 

2  3 

3  4 

NCARSLONG- NAMES 
VALUE  NAME 
0  1 

1  2 

2  3 

NCARSNPLO-NAMES 
VALUE  NAME 
0  1 

1  2 

NCARSNPLI- NAMES 
VALUE  NAME 
0  1 

1  2 

2  3 

3  4 

NCARSNVHL2- NAMES 
VALUE  NAME 
0  2 

1  3 

2  4 

3  5 

DIFFCSHAPE- NAMES 
VALUE  NAME 
0  3 

1  4 

2  5 

DIFFLSHAPE- NAMES 
VALUE  NAME 
0  1 

1  2 

2  3 

3  4 

DIFFNPL- NAMES 
VALUE  NAME 
0  2 

1  3 


OIFFNVHL- NAMES 
VALUE  NAME 


0 


DIFF.TYPE-NAMES 
VALUE  NAME 
0  1 
1  2 

CSHAPE4-NAMES 
VALUE  NAME 
0  UNK 

1  OPEN SECT 

2  CLOSDRECT 

3  ELLIPSE 

4  JAGGED TOP 

LSHAPE4- NAMES 
VALUE  NAME 
0  UNK 

1  HEXLOD 

2  CIRLOD 

3  TRILOD 

4  RECTLOD 

NPL4-NAMES 
VALUE  NAME 

0  UNK 

1  0 

2  1 

3  2 

NVHL4- NAMES 
VALUE  NAME 
0  UNK 

1  2 

2  3 

JTYPE4-NAMES 
VALUE  NAME 
0  UNK 

1  CL 

2  BK 

CSHAPE4-STRUCTURE 

NAME  SUBNAME  SUBNAME  SUBNAME  SUBNAME 

KNOVABL  OPENRECT  CLOSDRECT  ELLIPSE  JAGGED  TOP 
CLOSDTOP  CLOSDRECT  ELLIPSE  JAGGEDTOP  S 

LSHAPE4-STRUCTURE 

NAME  SUBNAME  SUBNAME  SUBNAME  SUBNAME 

KNOWABL  HEXLOD  CIRLOD  TRILOD  RECTLOD 


NPL4-STRUCTURE 


NAME  SUBNAME  SUBNAME  SUBNAME 

KNOVABL  0  1  2 

NWHL4-STRUCTURE 

NAME  SUBNAME  SUBNAME 

KNOVABL  2  3 

WTYPE4 -STRUCTURE 

NAME  SUBNAME  SUBNAME 

KNOUABL  CL  BK 

Note:  the  EVENT  tables  shown  in  Sec.  C.J  are  inserted  here  in  the  input  file. 


C.7.  Results  from  attribute-based  clustering  of  trains 

The  following  output  is  generated  from  the  input  file  by  the  program  CLUSTER/2. 

CONJUNCTIVE  CONCEPTUAL  CLUSTERING  PROGRAM  CLUSTER/2  LAST  UPGRADE:  04/10/84 
PARAMETERS 

MINN  MAXK  TRACE  HI  H2  H3  INITMETHOD  NIDSPEZD  COVER  TYPE  CRITERION  BASE  PROBE  BETA 
2  2  ON  4  4  4  RANOOM  SLOW  DISJOINT  DS  2  20  3  0 

OS-CRITERION 

*  CRITERION  TOLERANCE 

1  -COM  0  95 

2  DIM  000 

CLUSTERING  TRAINS  USING  58  DERIVED  ATTRIBUTES 


EXPERIMENT  1:  X=2.  CRITERION=DS 


THE  2  BEST  CLUSTERINGS  FOLLOW  (268239  MS) 

I  TER  /  CP  LX  t  VL-RULE  SEED 

9  1  [ SAKEVTYPE1 23:  l  ]  [ VTYPEl =BK ,  CL ]  4 

t  NCARSCLOSDREC  =  0  1] 

:NCARSCL0SDT0P?1  2] !NCARSHEXAG0N-0] 
[NCARSRECTLODM  2]  [NCARSNPL2-0  1] 
[NCARSNPL0=1 ' £NCARSWTYPEMXD=0] 

[DIFFWTYPE=1  ]  [NE3CTRA 1CAR-0]  [NPL4<>0J 
EVENTS  COVERED  1.4.8.9.10 
9  2  iCSHAPE2o  OPEN  TRAP]  2 

;CSHAPE3c>SLOPETOP] ;FAWTYPEBX=Oi 
!FAWTYPECL=0] [FALSHAPERECT=0] 

;lshape2=trilod.cirlod] 

:LSHAPE3=TRILOD.RECTLOD] [NCAR=3  41 
] NPL3= 1 ] ;n.HL2=2: :SAMEiTYPE123=0] 


-COSTS - 

-COM  DIM 

12  -2  Thu  cluttering  it  hated  on  the 

number  of  different  wheel 
type t  in  the  train  It  it  illut- 
trated  m  Fig.  7  SB  Clutter  I 
conteini  traini  with  only  one 
type  of  wheel 

33  -2  Clutter  t  contoini  traini  with 

two  lypet  of  wheelt 


lRCARSSLOPE=0]  (NCARSOPERTOP-1  2] 

{ NCARSCLOSD  TOP=2  3) 

[NCARSOPENREC=0  1] 

[HCARSOPENTRAP=0  1]  [NCARSE2-LIPSE=0] 

[ RCARSSHORT = 1  3] [NCARSLONC-1  2] 

( NCARSHEXLOD-O ] [HCARSCIRLOD= t ) 

[NCARSRECTEOD-O  . 1} [NCARSTRILOD= 1  2) 

[RCARSRPL1  =  1 .  .3]  [NCARSNUHL2-3  4] 

(RCARSVTYPECL=0  .3] 

[RCARSUTYPEBK=I. .3] [DIFFCSHAPE=3  .4] 

;.'>IFFLSHAPE=2.  .3]  [DIFFVTYPE=2] 
iNEXTRA2CAR=0] [CSHAPE4  <  > OPEN RECTI 
(LSHAPE4OHEXL0D) 

EVERTS  COVERED  2. 3. 5. 8. 7 

9  TOTALS  45  -4 


28  1  [CSHAPE2=0PENT0P] [CSHAPE3< >SLOPETOP] 

[FAWTYPEBK=0] [FALSHAPERECT=0] 
[LR2-SH0RT] [LSHAPE2-TRILOD , CIRLOD] 
(LSHAPE3=TRIL00. RECTLOD] [RCARM  5] 
[RPL2=1] [NPL3=1] [HUHL2=2] 
[SAMENWHL123= 1 ]  [VTYPE3=CL]  [VTYPEUBI. 
CL] [RCARSCLOSOREC^O  lHRCARSSLOPErO] 
[ NCARSCLOSDTOP=2 .  3] 

[RCARSOPERREC-O  11 CRCARSSH0RT=2  4] 
CRCARSLOHG-1.  2] [HCARSHEXLOD-O] 
[NCARSNPL1=2  4HNCARSRVHL2=3  5] 
[RCARSVTYPEMXD^OI [RCARSVTYPECL=3  5] 

[ NCARSVTYPEBK  =0  l!  [0IFFCSMAPE=4  5] 
iDIFFLSHAPE-2  3] [LSTIRFR0RT3=0] 
[CSHAPE4=XN0WABL] ’RPL4-KR0UABL] 
[RVHL4=KR0UABLI ;VTYPE4=CL] 

EVERTS  COVERED  2. 3. 4. 7. 9 
28  2  [RCARSJAGGED  =  0] ] RCARSOPERTRAP =0] 

[RCARSHEXAG0N=0]  'NCAAS  ELLIPSES: 

[ RCARSSHORT  = l  2!  [RCARSL0RG=2  3] 

:hcarsctrlod-o  i; ;rcarstrilod=o  u 

[ RCARSRPL2-0  1 ] [ RCARSRPLO= I ] 
[NCARSRPL1= 1  3] ]RCARSRVHL2=2  4] 

[RCARS‘.TYPECL=0  3]  :0IFFCSHAPE=3I 
[RPL4<  >0]  [WTYPE4' -CL] 

EVERTS  COVERED  1.3.8.8.10 
28  TOTALS 

(208  STARS  BUILT) 

FOR  THE  BEST  SOLUTION  ABOVE,  S=  8  4E‘022 


ACTIVITY  STATISTICS 

CENDIST  =  38  CRITVAL  =  18578  CLUSTER  = 

CMPCOV  r  0  EXTEND  =  8582  FREECPLX  = 


2  33  -2  The  alternative  cluttering  n 

hated  on  the  number  of 
different  ear  tkapei  in  the 
train.  It  it  illaetrated  in  Fig. 
1  SA  Clutter  t  contain* 
train*  witA  4  to  5  different  ear 
tkapet  and  each  train  kat  a 
fourtk  ear  with  clear  wkeelt 


5  16  -2  Clutter  !  eonlaint  train*  vif k 

3  different  ear  tkapet  and  the 
fourth  ear  doet  not  have  clear 
wkeelt  (tkii  include t  eatet 
where  the  fourth  ear  doet  not 
exit t) 


49  -4 


35 

8598  GERRLIZ  -  .556 


I 


189 


I 

I 

1 

S 


INTRSCT 

=  5215 

NID 

=  517 

NUMSE1.  = 

18578 

NEWCPLX  = 

8872 

REDUCE 

=  6582 

REFHIGH 

=115512 

REFNUM  = 

0 

REFUN  ION  = 

38167 

REFLEV 

=1371740 

REFLOW 

=161291 

SETMAP  = 

18578 

SETLEVELMA= 

0 

STAR 

=  208 

SEMANTICS 

=  1449 

SYNDIST  = 

0 

TRIM 

208 

TCOVER 

=251600 

DEGISCT 

=  0 

CLUSTERING: 

1 

TABLESETUP= 

49 

3ESTC 

=  3614 

MCARD 

=  30539 

GEXPATH  = 

519 

CLEARCV  = 

2 

S.WECV 

=  35 

STAR2 

=  0 

268  564 

CP  SECS. 

154035B  CM 

USED 

I 

1 


C.8.  Results  from  attribute-based  clustering  of  trains  with  toxic  predicate 

The  following  output  is  generated  from  the  input  hie  after  the  addition  of  the 
TOXIC  chemical  descriptor  to  each  train  and  the  adjustment  of  descriptor  costs  to  give 
the  TOXIC  attribute  a  highly  favorable  cost. 

CONJUNCTIVE  CONCEPTUAL  CLUSTERING  PROGRAM  CLUSTER/2  LAST  UPGRADE  04/10/84 


K 

S 

R 

I 

S 

g 


§ 

8 

Z 


PARAMETERS 

MINK  MAXK  TRACE  HI  H2  H3  INITMETHOD  NIDSPEED  COVER  TYPE  CRITERION  BASE  PROBE  BETA  MASHEICHT  MINSIZE 
2  4  ON  4  4  4  RANOOM  SLOW  HIERARCH IAL  DS  2  2  3  0  99  4 


DS-CRITERION 

«  CRITERION  TOLERANCE 

1  SIM  0  90 

2  OIM  0  00 


TRAINS  DESCRIBED  BY  59  DESCRIPTORS 


EXPERIMENT  I  :  K=2.  CRITERION=DS 

THE  1  BEST  CLUSTERINGS  FOLLOW  (26329  MS) 


ITER  CPLX*  VL-RULE 

SEED  — 

. COSTS- - 

SIM 

DIM 

1  1  [CSHAPE30  OPEN  TRAP]  [FALSHAPERECT=0] 

[LSHAPE2=RECTL0D,CIRL0D]  [NPL3=U 

(wtypei=bk,cl: [NCARSCL0SDREC=0  1] 

1 

-90 

-1 

Thu  e tattering  it  %Uuttrated  in 
Fig  7  7 

[NCARSCLOSDTOP=2  3]  [NCARSELLIPSE=0] 
[NCARSSHORT=l  3) [NCARSL0NC=2  3] 
;ncarscirloo=i  2]  ;ncarsnpli=2  4i 

(NCARSVTYPEMXD=01  ;0IFFCSHAPE=3  4] 
;0IFFLSHAPE=2  4]  :TOXIC=T] 

EVENTS  COVERED  1.3. 7. 8. 9 


1  2  [CSHAPE3OSL0PET0P]  [FAWTYPEBK=0]  2  -91  -1 

[LSHAPE3=TRIL0D ,  RECTLOD]  [NVHL2=2! 

[NCARSJAGGED=0] 'NCARSSL0PE=01 
[  NCARSOPEN  REC = 0  1) 

[ NCARSOPEN TRAP=0  1  ]  [NCARSHEXAGON=Ol 
[NCARSLONG=l .  21 (NCARSHE3CLOD=Ol 
;HCARSC1RL0D=0  .  1] [NCARSNPL2=0  11 
[NCARSNPLO=ll C  NCARSNVHL2=3  51 
[NCARSVTYPEBK=0 .  3)  [DIFFLSHAPE= 1  3] 

[ CSHAPE4  <  >OPENR£CT  1  [XWHL403] 

[TOXIC=F] 

EVERTS  COVERED  2.4.5,8,10 

1  TOTALS  -181  -2 

(16  STARS  BUILT) 

FOR  THE  BEST  SOLUTIOH  ABOVE.  S=  1  0E*023 


EXPERIMENT  1:  K=3.  CRITERION=DS 

THE  2  BEST  CLUSTERINGS  FOLLOW  <104880  MS) 


ITER/CPLX*  VL-RULE  SEED . -COSTS— . 

SIM  DIM 

1  l  CCSHAPE2=OPENRECTHCSHAPE3=SLOPETOP1  1  -100  0 


[FANWHL2=0] [FAWTYPEBK=ll (FAUTYPECL=Ol 
[FALSHAPERECT=0] [LN2-L0NG] [LN3=SH0RTl 
[  LSHAPE2= RECTLOD  j  [LSIIAPE3=TRIL0D] 
[NCAR=51 [NPL2=3] [NPL3=1] [NWHL2=2] 
[SAMENWHL  123=1!  ISAMEWTYPE123=1 1 
(WTYPE3=BKl  (WTYPEt=BNl  [VTYPE2=BK] 
(NCARSCL0SDREC=01 [NCARSJAGGED=01 
[NCARSSLOPE=U  [NCARS0PENT0P=3] 

[ NCARSCL0SDT0P=2 ] [NCARS0PENREC=3l 
[NCARSOPENTRAP=Ol  [NCARSUSHAPE=01 
[ NCARSDBLOPREC = 0 J  [NCARSHEXAG0N=0] 
[NCARSELLIPSE=Oi  (NCARSSH0RT=21 
[NCARSL0NG=3]  {NCARSHEXL0D=1 1 
l  NCARSC1RL0D=  1 1  !  NCARSRECTLOD  =  1 1 
[NCARSTRILOD= 1 1 [NCARSNPL2=0] 
[NCARSNPL3=1]  [NCARSNPLO=U 
[NCARSNPL1=31  [NCARSNVHL2=41 
[ NCARSNVHL3=  1 3  [NCARSVTYPEMXD=0] 
[NCAASWTYPECL=0]  [NCARSWTYPEBK=S] 
C0IFFCSHAPE=3]  [DIFFLSHAPE=41 
[DIFFNPL=31 [DIFFNVHL=21 [ 0 IFTWTT PE= 1 1 
iLSTINFR0NT3=0] [NECTRA1CAR=0! 
[NEXTRA2CAR=ll  [CSHAPE4=0PENRECT] 

L LSH APE4  =  HEDCLOD ]  tNPL4=ll  [NVHL4=3j 
(WTYPE4=BKl  [T0XIC=T1 
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EVENTS  COVERED:  1 

1  2  [ CSH APE3  <  >  SLOPETOP !  [FAVTYPEBK=0!  2  -91  0 

[ LSH APE3= TRILOD , RECTLOD ] £NUHL2=2] 

(NCARSJAGGED-0] [NCARSSL0PE=0] 

[NCARS0PENREC=0 .  1] 

(NCARS0PENTRAP=0  1] [NCARSHEXAG0N=0] 

[NCARSLONG= 1  2] [NCARSHEXL0D=0] 

£NCARSCIRL0D=0  1] [NCARSNPL2=0  1] 

;NCARSNPL0=1] [NCARSNVHL2=3  5] 

[ MCARSVTYPEBK =0  3]  '0 IFFLSHAPE=  1  3 ! 

[CSHAPE4O0PENRECT]  [NWHL4<>3] 

;toxic=f] 

EVENTS  COVERED  2.4,5,8.10 

1  3  [C3HAPE3OSL0PET0PJ  [FAVTYPEBK=0]  3  -89  0 

[FALSHAPERECT-O]  [LSHAPE2=RECTL0D . 

CIRLOD] [NPL2=ll [NPL3=1] tWTYPE3=CL] 

[WTYPE1=BK ,  CL]  [NCARSCL0SDREC=0  1] 

[NCARSSL0PE=0] [NCARSCLOSDTOP-2 .  3] 

(NCARS0PENREC=0  1]  [NCARSm.IPSE=0] 

£ NCARSSHORT = 1  3] (NCARSL0MC=21 

[NCARSHEXLOD-O] [ NCARSCIRLOD= 1  2] 

£ NCARSNPL1 =2  4] [NCARSWTYPEKXD^O] 

£NCARSVTYPECL=3  3] 

£  NCARSVTYPEBK =0  1  ](DIFFCSHAPE=3  4] 

£DIFFLSHAPE=2] [DIFFNPL=2] 

[LSHAPE4OHEXL00]  [WTYPE4<>BK] 

[TOXIC=TJ 

EVENTS  COVERED  3. 7. 8. 9 

1  TOTALS  -280  0 

4  1  [CSHAPE2=0PENRECT] [CSHAPE3=SLOPETOP]  1  -100  -1 

£FANVHL2=0] [FAWTYPEBX=1] [FAVTYPECL=0] 

[FALSHAPERECT=0] [LN2=L0NC! [LN3=SH0RT] 

[LSHAPE2-RECTL0D] [LSHAPE3= TRILOD] 

[NCAR-S] [NPL2=3] [NPL3=1] £NWHL2=2] 
tSAMENVHL123=l]  [SAMEVTYPE123=1] 

£VTYPE3=BK]  [WTYPE1=BK]  [VTYFE2=BX] 

[NCARSCL0SDREC  =  0]  [NCARSJACCED=0] 

[  NC  ARSSL0PE=  1 1  [NCARS0PENT0P=3J 
[NCARSCL0SDT0P=2] [NCARS0PENREC=3] 

[NCARSOPENTRAP-O]  £NCARSUSHAPE=0] 

£NCARSDBLOPREC=0]  £NCARSHDCAG0N=0] 

£ NCARSELLIPSE=0] [NCARSSH0RT=2] 

£NCARSL0NG=3]  l»CARSHEXL0D=1) 

£NCARSCIRLOD=l]  [NCARSRECTLODM] 

[NCARSTRILOD= 1 ] [ NCARSNPL2=0 ] 

[NCARSRPL3= 1 ] [NCARSNPL0=1 ] 

£NCARSNPL1=3] [NCARSNVHL2M] 

CNCARSNVHL3=1]  tNCARSVTYPEMXD^O] 

£NCARSWTYPECL=OJ  'NCARSVTYPEBK=31 
;0IFFCSHAPE=3; [DIFFLSHAPE=4] 

:0IFF»PL=3! [DIFFNVHL=2] [DIFFVTYPE: 1 ] 
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tLCTIRFROHT3=0]  ;nextraicar=o] 

[HE(TRA2CAR=l! [CSHAPE4=0PEHRECT] 

[LSHAPE4=HEXL0D! (NPL4=ll [HVHL4=31 
[VTYPE4=BK! [TOXIC^Tl 
EVERTS  COVERED  1 

4  2  :CSHAPE2<  >OPERRECT:  4  8 

[ CSH APE3  <  >  SLOPETOP ] [FAVTYPEBK  =  Q I 
[FAVTYPECLM]  1HPL2M]  [SAMEVTYPE123=1J 
[WTYPE3=CL1  [JTYPEUCL1  C'.'TYPE2=CL! 

CNCARSCLOSDREC=0  l! [HCARSSL0PE=01 
:HCARSCL0SDT0P=1  2] 

[ncarsopehrec=o  i;  ;ncarshexagon=oi 

[HCARSLOMGM  2] [NCARSHEXL0D=01 
[MCARSRECTLOD=l  21  t*CARSRPL2=0  I] 

[MCARSNPL3=0]  (HCARSHPLO=ll 
I  RCARSVTYPENXD=0 1  t  MCARSJTYPECL- 3  SI 
(HCARSVTYPEBK=Ol  [0IFFLSHAPE=1  .2! 

CDIFFVTYPE=1]  [HEXTRA1CAR=0] 

[LSHAPE4OHEXL0D]  [HPL4<>0]  [HVHL4<>3] 

[VTYPE40BK] 

EVERTS  COVERED  4.8.9.10 

4  3  [ CSHAPE3  <  > SLOPETOP 1  [FAVTYPEBK=0]  7  17 

[FAVTYPECL-01 'FALSHAPER£CT=01 
E  LSHAPE2-TRIL0D . CIRLOD 1 
[LSHAPE3=TRIL0D.RECTL0D] [NCAR=3  41 
[ HPL3- 1 1 [NVHL2=2l JSAMEUTYPE1 23=01 
IRCARSSL0PE=0)  t»CARSOPERTOP=  1  21 

[  HCARSCL0SDT0P=2  31 
[RCARS0PERREC=0  1] 
iNCARSOPERTRAP-O  1] [HCARSELLIPSE^Ol 
l  MCARSSHORT  = 1  3]  [NCARSL0HG=1  2] 

;hCARSHEXL0D=0]  [RCARSCIRL0D=1I 
[HCARSRECTL0D=0  11 [HCARSTRIL0D=1  21 
;NCARSRPL1=1  31 [RCARSHVHL2=3  41 
[RCARSUTYPECL=0  31 
[RCARSVTYPEBK=1  3]  [DIFFCSHAPE=3  4] 

(0tFFLSHAPE=2  31 !0IFFUTYPE=21 
[HEXTRA2CAR=0J [CSHAPE4<>0PE»R£CT! 

[LSHAPE4OHEXL0D] 

EVERTS  COVERED  2. 3, 5, 8, 7 

4  TOTALS  -75 

(88  STARS  BUILT) 

FOR  THE  BEST  SOLUTIOH  ABOVE.  S=  1  7E*022 


EXPERIKERT  1.  K=4.  CRITERIOR=DS 


THE  2  BEST  CLUSTERIRCS  FOLLOW 


(319009  MS) 


1 
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n 
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*.  k 

I 

B 

1 

i 

5 

w  k 

Ss 

'A 
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ITER,  CPLX*  VL-RUIX  SEED - COSTS - 

SIM  DIM 

1  1  ;CSHAPE2=0PENRECT] [CSHAPE3=SLOPETOPJ  i  -100  0 


[FAKWHL2=0]  [FAWTYPEBK=  1 1  [FAWTY|'£CL=0] 

:FALSHAPER£CT=0] ILK  2= LONG] [LN3=SH0RT] 

[LSHAPE2=R£CTL0D1  [LSHAPE3=TRIL0D] 

[NCAR=5] [NPL2=3 j ;nPL3=11 :»WHL2=2] 

[SAMEMVHL123=1]  [SA«E.TYPE123=1  1 
[VTYPE3=BK] l'JTYPE1=8K1 [*TYPE2-BK i 
;ncarsclosdrec=oi [NCARSJAGGED=0! 
tNCARSSLOP£=l] 'NCARSOPERTOP=31 
[NCARSCL0SDT0P=2] [NCARS0PEHREC=3] 

[NCARSOPERTRAP=0] [NCARSUSHAPE=01 
(NCARSDBLOPREC=01 [NCARSHEXACON-O) 

[NCARSELLIPSE=0]  [NCARSSH0RT=2] 

[NCARSL0RG=3] [NCARSHEXLOD=ll 
[NCARSCIRLOD= 1 1 [NCARSRECTLOD=  1 1 
[NCARSTRILOD= 1 J [NCARSNPL2=0] 

[NCARSMPL3=ll iNCARSNPLO=ll 
[RCAASRPL1=3]  iNCARSNVHL2=4] 

[NCARSNWHL3=  1  ]  [RCARS,JTYPEMXD=0] 

[RCARSVTYPECL=01  !NCARSVTYPEBK=51 
C0IFFCSHAPE=3] [DIFFLSHAPE=4! 

[DIFFRPL-3]  [DIFFRVHL=21  CDIFFVTYPEMl 
[LSTIRFR0RT3-0]  IKEXTRA1CAR=0] 

IREXTRA2CAR=H  [CSHAPE4=0PERRECT] 

[ LSHAPE4  =  HEXLOD ]  [RPL4=l]  [NVHL4=31 
[VTYPE4=8K] :TOXIC=T] 

EVERTS  COVERED  1 

1  2  [CSHAPE2-0PERT0P)  [CSHAPE3OSL0PET0P1  2  -87 

[FAVTYPEBK=0! ! FAWTYPECL=0] 

[FALSHAPERECT-O! iLR2=SH0RT] 

[LSHAPE2=TRIL0D]  [LSHAPE3=R£CTL00l 
[NCAR=4]  [NPL2M]  [RPL3=1]  [RVHL2=21 
[SAMEVTYPE123=0]  tWTYPEl-BX ,  MXD] 

[RCARSCLOSDAECM  2]  [NCARS JAGGED- 0] 

[NCARSSLQPE-O] (RCARSOPERTOPM  .2) 

[NCARSClJOSDTOP=2  3)  [RCARS0PERREC=0) 

[ NCARSO PER TRAP =0  J] (»CARSHEXAC0N=01 
CRCARSELUPSE=0KRCARSSH0RT=2  31 
[RCARSU)RG  =  1  21 iHCARSHEXLOD^O) 

[ NCARSCXRLOD= 1 1 1 NCARSRECTLOD- 1 J 
[RCARSTRILOD=U  1RCARSRPL2=0  11 
[RCARSRPLO-tl 1NCARSKPL1=2  .3] 

;NCARSRVHL2-3  41  [RCARSVTYPECL=0  31 
[RCARSVTYPEBK- 1  3) 10IFFCSHAPE=3  41 

(0IFFLSHAPE=31  [DIFFVTYPE=21 
[LSTIRFR0NT3=01 [NEXTRA  1CAR=1  ] 

[RE3CTRA2CAR=:01  ;CSHAPE4=CL0SDRECT1 
[LSHAPE4=CIRL0D1  [RPL4=EXISTS] 

[RVHL4=2J  [VTYPE4=EXISTS1  (TOXIC=F] 

EVERTS  COVERED  2.5 
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1  3  iCSHAPE3<>SL0PET0Pl [FAUTYPESK-01  3  -89  0 

JFALSHAPERECT=Ol  [LSHAPE2=RECTL0D, 

CIRLCD) tNPL2=l] [MPL3-1 J [VTYPE3=CL] 

[WTYPEl=BK,CLi [NCAR£CL0SDREC=0  1) 

[ NCARSoL3PE-0 1 [ NCARSCLOSD T0P=2  3] 

iNCARS0PENR£C=0  1 ] :NCARSELLIPSE=0) 

[ NCARSSHGRT = 1  .31  [NCARSL0NG=2! 

;ncarshexlod=oj  !ncarscirlod=i  21 

[NCARS3PL1=2  4) [NCARSVTYPEMXD=Ol 
iNCARSVTYPECL=3  .  51 
;NCAAS'-'TY?EBK=0  11  [DIFFCSHAPE=3  4] 

[DIFFLSHAP£=2] [DIFFNPL=2] 

[LSHAPE4OHEXL0D!  [WTYPE4oBK] 

[TOXIC=T] 

EVENTS  COVERED  3. 7. 8. 9 

1  4  [CSHAPE2O0PEN  RECTI  [CSHAPE3=0PENT0P1  4  -88  0 

[FANWHL2-1]  [FAWTYPEBK=0] 

[LSHAPE3=TRIL0D ,  RECTLQD1  (NUHL2=21 
1 SAMENVHL 1 23= 1 1 [UTYPE3=CL1 [WTYPE1 =BK . 

CL] [WTYPE2-CL] (NCARSCL0SDREC=0  1] 

[NCARSJAGGED-O] [NCARSSL0PE=0] 

1 NCARSCLOSD  TOP  =  1  21 [ NCARSOPENR£C= 1 ! 

[NCARSOPENTRAP-O  1] [NCARSHEXACON=Ol 
[NCARSL0NG=1  21 [NCARSHEXLQD=0] 

[ NCARSCIRL0D=0  lit  NCARSNPL2=0  11 
[NCARSNPLO=l! [NCARSNWHL2=3 . .51 
[ NCARSNVHL3=0 1 [NCARSVTYPEMXD=03 
[NCARSUTYPECL=2  .51 
[  NCARSVTYPEBK  =0  1 1  [DIFFLSHAPE=  1  21 

[DIFFNVHL=1 1 :NEXTRAlCAR=Ol 
[CSHAPE4O0PEN RECTI  [LSHAPE4OHEXL0D) 

[NPL4O01  (NVHL403)  [VTYPE4<>BK] 

[TOXIC=Fl 

EVENTS  COVERED  4.8.10 

1  TOTALS  -364  0 

3  1  [CSHAPE2-0PEN RECTI iCSHAPE3=SL0PET0P]  l  -100  0 

[FANVHL2=0] [FAWTYPEBK=1 1 [FAWTYPECL=0] 

[FALSHAPERECT=Ol 1LN2-L0NG1 [LN3=SH0RT) 

ILSHAPE2=RECTL0D]  [LSHAPE3=TRIL0D] 

[NCAR=Si [NPL2=3] [NPL3=t] [NVHL2=21 
C  SAKENVHL 123=11 [SAMEWTYPE123=1 1 
[VTYPE3-BX!  [VTYPE1=BK]  [WTYPE2=BK1 
[ NCARSCLOSD REC =01 !NCARSJAGGED=01 
t NCARSSLOPE= 1 1 [NCARS0PENT0P=3! 

[NCARSCLOSDTOP=2] [NCARS0PENREC=3J 
[NCARSOPENTRAP=Ol [ NCARSUSHAPE=0 1 
[NCARS0BL0PREC=0] [NCARSHEXAC0N=0] 

;NCARSELLIPSE=01 [NCARSSH0RT=2] 
lNCARSL0NG=3] [NCARSHEXL0D=1] 
lNCARSCIRLQD=  1 1  INCARSRECTLODM] 
r.NCARSTRILOD=ll  [NCARSNPL2=01 


:NCARSMPL3=1]  CNCARSMPL0=1] 

;nCARSMPL1=3] ;nCAR3RVHL2=4] 

[HCARSNWHL3=1] !NCARSWTYPEMXD=0] 

.'KCARSVTYPECL^O]  :NCARS'«TYPEBK=5! 
iDIFFCSHAPE=3]  ]DIFFLSHAPE=4] 

[DIFFRPL=3] [DIFFRVHL=2] iDIFFVTYFE=  1  ] 

!LSTIRFR0NT3=0] [KEXTRA1CAR=0! 

[ NDCTRA2CAR=  1  ]  tCSHAPE4=0PERR£CT] 

:LSHAPE4=HEXL0D!  CMPL4=l] [HVHL4=3] 

CVTYPE4=BK]  [T0XIC=T] 

EVERTS  COVERED  1 

2  [CSHAPE2O0PENRECT]  fCSHAPE3=0PERT0P]  2  -85  0 

( FARWHL2 -  1 1 [FAWTYPEBK=0]  [FAWTYPECL=0] 

[FALSHAPERECT=0] [LR3=SHORT] 

[LSHAPE2=TRXL0D,CIRL0D] 

[LSHAPE3=TRIL0D.RECTL0D] [RCAR=3  4j 
[RPL3=1] [NWHL2=2! [SAMERVHL123=1 ] 

[SAMEWTYPE123=0]  [«TYPE3=CL] 

[«TYPE1=8K]  [WTYPE2-CL] 

CRCARSCL0SDREC=1] [NCARSJAGGED-O] 

[NCARSSLOPE=0) "NCARSOPERTOP- t  2! 

!XCARSCL0SDT0P=2] [RCARSOP£RREC=0  1) 

[RCARS0PERTRAP=0  1) [MCARSDBU)PREC=0] 

IMCARSHEXAGON -0] [RCARSE1XIPSE=0] 

]NCARSSHORT= 1  3] [RCARSL0RC=1  2] 

[  MCARSHEXLOD-O !  (NCARSCIRLOD=ll 
'RCARSRECTLOD^O  l! [NCARSTRILOD^ l ! 

E RCARSRPL2-0  1 ] [ RCARSHPLO=  t ] 

[NCARSRPLm  2] [HCARSRVHL2=3  4] 

;nCARSHWHL3=0]  [RCARSWTYPEMXD=0] 

[RCARSVTYPECL=2  3) [ RCARSVTYPEBK -  1 ] 

[ D IFFCSHAPE=  3  4 ]  l D IFFLSHAFE=  2  3] 

[DIFFRPL=3] [DIFFRVHLM] [DIFFVTYPE=2] 

[ MEXTRA2CAR=0 ]  [CSHAFE4C  >OPERRECT] 

[ LSHAPE4 < > HEXLOD ] !NPL4<>0j  CRVHL4<>3] 

[VTYPE40BK]  (T0XIC=F] 

EVERTS  COVERED  2.6 

3  [CSHAPE3OSL0PET0P]  [FAWTYPEBK=0]  9  -89  0 

[FALSHAPERECT=0] [LSHAPE2=RECTL0D . 

CIRLOD] [RPL2=1] !KPL3=l]  lVTYPE3=CL] 

[vtypei=bk,cl; ;rcarsclosdrec=o  t] 

E RCARSSL0PE=0 )  [ NCARSCL0SDT0P=2  3 ] 

[RCARS0PERREC=0  I  ]  [RCARSEXLIPSE=0] 

[RCARSSH0RT=1 . .3] [HCARSL0RG-2] 

[RCARSHEXLOD^O] [RCARSCIRLOD-1 .  2] 

[NCARSXPLU2  4]  [NCARSVTYPEMXD=0] 

[RCARSVTYPECL=3 .  5] 

[ RCARSVTYPEBK =0  1 ]  [ D IFFCSHAPE= 3  4] 

[ D IFFXSHAPE=2 ]  E0IFFRPL=2] 

[LSHAPE4OHEXL0D]  [VTYPE40BK] 

[TOXIC=T] 

EVERTS  COVERED  3,7,8, 9 


10ft 


3  4  [CSHAPE2=0PENT0PJ [CSHAPE3< >SLOFETOP!  4  -88  0 

[FAUTYPEBK-O] CLN2=SH0RT] 

CLSHAPE2=RECTL0D . TRILOD] 

[ LSHAPE3= TRILOD , RECTLOD) (NPL2=lJ 
[MUHL2-2]  [VTYPE1=CL.MXD] 

:SCARSJACGED=0] [NCARSSL0PE=0] 

[NCARS0PENREC=0.  1] 

[ NCARS0PENTRAP=0  l! [NCARSHEXAG0N=0] 

'NCARSL0NG=1  2] [NCARSHEXL0D=0] 

;ncarscirlod=o  l! [NCARSRECTLOD=t  2] 

[ NCARSNPL2=0  1 ] [ NCARSNPLO= 1 ] 

[ NCARSNVHL2=3  5] [NCARSVTYPEBX  =  0  3) 

[DIrFLSHAPE= 1  3] [CSHAPE4< >OPENRECT) 

[RPL4O0]  (RWHL403)  [TOXIC=F] 

EVERTS  COVERED  4.5.10 

3  TOTALS  -382  0 

(182  STARS  BUILT) 

FOR  THE  BEST  SOLUTION  ABOVE.  S=  9.2£*019 

ACTIVITY  STATISTICS 


CENDIST 

=  18 

CRITVAL 

=  29992 

CLUSTER 

=  15 

C'TCOV 

—  0 

EXTEND 

=  13931 

FREECPLX 

=  18281 

GENRLIZ  =  20966 

INTRSCT 

=  19803 

NID 

=  359 

NUMSEL 

=  0 

NE.CPLX  =  16751 

REDUCE 

=  13931 

REFHIGH 

=217288 

REFNUM 

=1789528 

REFUN I DN  =  69419 

REFLEV 

=2298741 

REFLOW 

=242492 

SETKAP 

=  29992 

SETLEVELMA:  0 

STAR 

=  268 

SEMANTICS 

=  1548 

SYNDIST 

=  0 

TRIM  =  698 

TCOVER 

=439230 

DEGISCT 

=  .  o 

CLUSTER ING=  1 

TABLESETUP=  51 

BESTC 

=  7387 

MCARD 

=  43217 

GENPATH 

=  370 

CLEARCV  =  8 

SAVECV 

=  15 

STAR2 

=  0 
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